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STUDY HIGHLIGHTS 



study Design & Data Collection 



The purpose of this study was to evaluate c- rumple of 
24 Community-Based Right to Read Projects, incluviitig two 
distinct models — 13 that served "in school" you*:! . i.e., 
student projects, and 11 that served "out of schoc^i" adults, 
i.e., adult projects. 

The evaluation objectives were: 1) to measure the 
improvement in reading achievement, and 2) to analyze the 
relationships between achievement and program, staff, and 
student characteristics. 

In order to measure reading achievement, pre- and post- 
testing was conducted between December 1973 and May 1974. 
The SRA Multi-Level Achievement Test (reading and vocabulary) 
was used for the student projects and the Reading/Everyday 
Activities in Life (R/EAL) test was used for the adult projects. 
For the SRA test, standard scores were used for the analysis, 
while raw scores were used for the R/EAL test. 

Relevant student and staff characteristics and termina- 
tions were collected through the use of individual student 
and staff Data Forms. Attendance Data Forms were used to 
collect individual student attendance information. An 
Attitude Scale was administered on a one time basis to four 
sample sites. Staff Questionnaires were administered to 
obtain staff input on program operations and effectiveness. 

Pr-oject data was collected through the use of a Project 
Interview Guide and classroom and tutoring activities w.->re 
observed through the use of an pn-Site Observation Guide. 

Testing and data collection began on December 1973 and 
ended in May 1974. Evaluators made three visits to each site 
and established an ongoing information system. All data were 
checked, keypunched, computerized and analyzed. Test scores 
were analyzed by using the residual gain score approach and 
comparisons were made by primarily using analysis of variance. 
The following presents a sumriary of the major findings of the 
study. 



Fi ndi ngs 



Student Projects 

• Overall, students gained significantly in reading skills 
during the five months between pre- and post-testing, 
achieving a gain of 16.73 standard score points as com- 
pared with an expected gain of 12 points for "average" 
students. This is particularly notable since participating 
students were underachievers and would therefore be expected 
to achieve below the norm. Identification of the students 
as underachievers is based on a mean entry level GE of 6.6, 
whereas 90% of the students had actually completed 7th 
grade or more and 50% had completed 9th grade or more. 

• The greatest gain was achieved by students in classroom 
projects operating within the regular school context 
(Type I; y students in classroom projects operating outside 
of school, or outside of school hours (Type II) , ranked 
second in effectiveness? tutorial projects operating outside 
of a school (Type III) achieved the least gain. 

• Significant differences were found cimong the individual 
projects, but, aside from the characterization by Type 
(as cited above) , no consistent differences were found in 
relation to such individual programmatic features as class 
size, staff /pupil ratio, or cost per student. 

• The over-all termination rate was 23%, comparing favorably 
with the nearly 50% ratt identified in the literature for 
similar programs. Type 1 projects were found to have the 
lowest termination rate as well as the greatest gain; Type 
II projects again ranked second; and Type III third. 
Primary reasons for termination (in rank order) included 
non-attendance, lack of interest, time conflicts and 
"moved". 

Jmalysis of achievement in relation to student character- 
istics revealea that: 

• Students who were older, had more prior schooling, and high- 
est entry level skills gained the most. 

• Black and Span! sh-sur named students made the greatest gains 
(since programs tended to serve one predominant ethnic group, 
it is possible that this finding reflects the quality of 
particular projects and higher entry level skills as well 

as ethnic differentials) . 

• The number of hours of participation in the instructional 
prograiDs"Tid not relate to outcome with the important excep- 
tion that students who attended the greatest grogortion of 
classes available to tham did better than stuaents witH 
irregular attendance. 
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• students who percei'^ed their participation as voluntary 
did better than those who perceived their participation 
as compulsory. 



Adult Projects 

• The adult participants demonstrated significant gains in 
reading achievement, as evidenced by a 6.15 mean increase 
in R/EAL scores. Specifically, the -typical" adult entered 
with a R/EAL score of 19.88 (functional illiteracy, accord- 
ing to the normative data for the R/EAL); and gained 6.15 
in the 4 to 6 month evaluation period, achieving an ending 
score identified as marginal literacy (but still substan- 
tially below the functional literacy level of 36) . This 
suggests that, while significant gain was achieved, move- 
ment from illiteracy to full functional literacy may be 
expected to require a longer, more intensive effort. 

• Projects were characterized as ESL classroom instruction, 
tutoring programs utilizing paid tutors and tutoring programs 
utilizing volunteer tutors (Types I, il, and III respectively). 
No significant differences were found among these three 
types. Differences were found among individual projects, 

but no program variables were found which relate consistently 
to project effectiveness. 

• The overall termination rate was 30.9%, which compares 
favorably to the termination rates of similar literacv 
programs; projects varied in relation to termination rates, 
with projects having high termination rates being generally 
more successful in terms of gains achieved by the continuees. 
"Moving" and non-attendance were the dominant reasons given 
for terminating. 

The following significant findings were identified in rela- 
tion to student characteristics.* 

• Those who can read their native language (if not English) 
achieved significantly more than those who cannot. 

• Those non-native English speakers who were fluent in English 
did better than those who were not fluent. 

• Those who perceived their participation as voluntary did 
better than those who did not. 
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INTRODUCTION 



T he Literacy Problem 

Illiteracy was spotlighted as a major priority for national 
action in 1969, when Dr. James Allen, the Commissioner of 
Education, launched the initial Rignt to Read Effort. Since 
then, the full dimensions of the problem have been substantially 
documented. The 1970 Census, for example, reported that 17 
million people aged 25 and older had completed less than 8 
years of formal education — yet even this impressive figure is 
considered by many authorities to be a low indicator of illiter- 
acy, since years of schooling is frequently a poor index of the 
ability to read. 1/ More recent estimates based upon actual 
perfoi-mance measures of reading show that no less than IS^s 
million adults are currently unable to perform even such basic 
tasks as the completion of various types of applications. 2/ 

Illiteracy is a problem, moreover, which faces school age 
youth as well as adults. Seven million elementary and secon- 
dary school students have severe reading problems and between 
40 and 50% of the children in large citiec are underachieving 
in reading, 3/ Hansen and Hesse, in a recent study of gradua- 
ting high sicFool students in Wisconsin, found that twenty-five 
to thirty percent were unable to perform simple reading tasks 
using materials they might be expected to encounter in every- 
day life. 4/ Similar results, moreover, have been obtained in 
numerous iuburban and rural communities in other parts of tne 
country. 5/ 



The United States, in company with France and Belgi'jin, 
shares the dubious honor of having the highest rate of func- 
tional illiteracy aincng the world's developed countries — and 
it appears clear that our absolute illiteracy figure is increas 
ing. 6/ 

While problems of illiteracy extend across all economic, 
ethnic, and geographic boundaries, their intensity increases 
significantly among disadvantaged groups. A recent study by 
the Public Health Service, for example, found the following 
rates of illiteracy among youth aged 12-17. 7/ 

While the rate for males was 6.7%, the rate for females 
was 2.8%. For Black males, it was 20.6% , while for Black 
females it was 9.60%. Children whose parents had no formal 
education had an illiteracy rate of 27.4%, with tne rate 
steadily decreasing as parental education increased. Geo- 
graphically, the South *s rate of 8.8% was significantly higher 
than that for any other region, and appreciably higher than 
the overall rate of 4.8%. Briefly, in other words, thess data 
suggest that illiteracy is more likely to be found among less 
privileged youth than eunong their more privileged counterparts. 
The logic of this situation is not difficult to grasp. 

Mass illiteracy clearly has negative consequences, both 
for the individuals involved and for society as a whole. 
Within the current techrologically sophisticated structure of 
the economy, functional illiterates are destined to remain on 
the lowest economic rungs of society. Since their ability to 
find or hold jobs is minimal, their relationship to the econ- 
omy is likely to be tenuous and marginal at best. As a tragic 
consequence, their social weight can more easily be measured 
in terms ot the country's welfare rolls, unemployment lines, 
and prison records than in terms ot employment figures. The 
costs of illiteracy to society, in other words, are high and 
rising. 



Peftnttton and Assessment 

Specifically, how is literacy to be defined? What does 
it mean "to be able to read"? Does it mean performance on tests, 
performance in real life, or some amalgam of the two? 

Traditionally, literacy assessments have been equated with 
standardized measures of reading achievement rather tnan per- 
formance measures. An individual is judged to be functionally 
literate if he/she receives a fifth to eighth grade score on a 
standardized reading test. According to llarman, the Office of 
Education routinely takes this approach, foregoing more prob- 
lematic performance measures of reading ability. 8/ 
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Less orthodox performance-orientea approaches have, on 
the other hand, been undertaken oy groups as diverse as UNESCO, 
the Census Bureau, and the Army. As early as 1951 UNESCO's 
Committee on the Standardization of Educational Statistics 
reported that a literate person should be able to read and 
write short simple statements on everyday life, while in 1962 
it reiterated its understanding of the functional aspect ot 
literacy, stating that literate citizens should have the 
essential knowledge and skills required for effective function- 
ing in their communities. 9/ The Census Bureau in 19 59 took a 
somewhat similar position, defining a literate person as some- 
one 14 or older who can read and write a simple message in 
English (or some other language) . For the Army, the functional 
literate is e person capable ot understanding the kinds of 
written instructions necessary for basic military functions . 10/ 

Since competent performances on real-world tasks emphasiz- 
ing the practical coping problems of adults are the generally 
accepted indicators of tunctional literacy, 11/ Han, an aroues 
that we should avoid grade equivalencies and use documents such 
as income tax forms, driving instructions, television guides, 
and job applications for the assessment of truly functional 
literacy. This viewpoint is also expressed by those concerned 
with worldwide literacy who define adult literacy as effective 
functioning in the community . 12/ 

The operational implementation of thinking of tnis kind 
has been initiated by five groups in particular: 

CI) The Committee tor the National Assessment of Educa- 
tional Progress (1972)— which devised test items revolving 
largely around problems of actual practical experience; 

(2) The Adult Performance Level Study (1973)— which 
used items and questions dealing with practical applications 
of reading and other coping skills? 

(3) The Educational Testing Service (1972-74) — which 
att&uped to develop items reflective of the carefully studied 
reading habits of adults ; 

(4) The Army (1972)— which used Job Reading Task Tests 
to assess reading competencies; and 

(5) Harris (1970) — whose survey approach involved the 
completion of applications. 13/ 

In other tests, adults themselves have indicated a need 
for literacy skills applicable to their daily needs. One 
group of adults, responding to a request to compile a list 
of literacy needs, mentioned items sucn as the ability to 



read signs and manuals, use recipes, read labels, fill out 
applications, and help their children with their honiewcrk . 14/ 
Although much pioneering work has begun, considerable furtHer 
development is still necessary for the successful utilization 
of performance criteria for the measurement of literacy. 

Par fewer controversies arise within the realm of the 
assessment of reading tor in-school student populations. 
While views have Deen expres -d (1) that tests should avoid 
all bias relating to racial u:. ethnic background, (2) that 
tests be representative of actual skills taught, (3) that 
tests actually focus on reading objectives, (4) that test 
content and format avoid error in scoring and interpretation; 
It is nevertheless generally accepted that the assessment of 
reading ability for in-school students can be made relatively 
well with many of the currently revised standardized readinq' 
tests. 15/ ^ 



The Right to Read Program 

Federal action directed towards the solution of the 
illiteracy problem began with the inception of the Right to 
Read effort in 1970. "The Right to Read campaign is a national 
Effort to eliminate illiteracy. It involves state, local, 
private, and federal contributions. The Right to Read Program 
m the Office of Education is part of this larger Effort. "16/ 
The goal of the Program is to help educational institutions, 
government agencies, private industry, and non-profit organiza- 
tions in their efforts to tight illiteracy. The Program is 
thus neither a single reading project nor a unique teaching 
method, but a planning center for the coordination of all 
available resources. 



Initially, the primary strategy of the Program was the 
establishment of demonstration reading programs. These were 
to be of two kinds: first, school-based programs operated by 
local education agencies, which were funded to provide remedial 
reading skills to public school students; and second, community- 
based sites operated by non-profit and educational institu- 
tions, which were funded to provide reading services to adults 
and youth outside the public schools* Additionally, the 

Program provided seed money to state Education Agencies to 
help them implement statewide Right to Read Programs; 
coordinate efforts with other Offices of Education Programs; 
and identify, package, and disseminate existing exemplary 
reading programs. 



* 

In fact, these sites spcve both in-school and out-of-school youth. 



Conununity-Based Programs 



So far, we have presented a brief picture of the Right 
to Read Effort — its various programs and its past and present 
priorities, since the purpose of this study in particular has 
been the evaluation of community-based programs, a fuller des- 
cription of this component is now desirable. 

Community based programs have been funded since 1972, and 
currently (during FY 74) 73 projects are being funded at a 
total cost of $3,155,618. 

Community-based sites represent an extremely broad range 
of local efforts, diverse most importantly in terms of target 
group participants, methods of organization, and instructional 
strategies. 

• Community-based sites serve a vast spectrum of population 
groups, ranging from elementary school students to college 
students, from young high school graduates to the elderly, 
from the high school or college level reader to the illiterate, 
from people noping to improve their study skills to people 
hoping to understand road signs. Participants include members 
of almost all ethnic groups, with a large proportion of Blacks, 
Chicanes, Latinos, and foreign-born minorities. 

• Community-based sites are operated by colleges, libraries, 
penal institutions, and conmiunity organizations. They are 
located in cities, suburbs and rural areas in all parts of the 
country . 

• Operationally, these projects may serve less than 30 people 
or more than 500 people, depending upon the structure and 
availability of local resources. Services are provided both 
through large and small classes and through individual tutorials. 
Instructors include paid professionals, work/study students, 
paid non-professionals, ^nd volunteer tutors. Teaching techni- 
ques range from formal methods to eclectic and locally devised 
approaches. Materials range from prograirmed texts to skill 

kits and a wide variety of self-made approaches. Program content, 
similarly, varies from basic English to advanced study skills. 

While the sites vary significantly in all of these terms, 
they are bound together by their shared goal of exploring new 
ways to improve the reading skills of their participants— a 
goal which almost requires diversity. Thus, the primary federal 
strategy in establishing community-based demonstration programs 
I has been] to develop exemplary modes for conducting effective 
reading programs. . . The long range plan is to prepare case 
histories fran which to extract salient program features to be 
utilized by others. The findings from these programs will 
serve as lighthouses for many forthcoming programs in the 
National Right to Read Effort. "17/ 
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Future Plans and Priorities 



With the completion of its three year demonstration effort 
at the end of FY 74, Right to Read will move to a new set of 
priorities. Basically, the program will shift to a decreasing 
emphasis on the federally dir«>c<-ed "demonstration" aspect of 
the initial effort and 'nto a phase of state-by-state coordina- 
tion, consolidation, and innovation. Accordingly, 68 of the 
106 school-based demonstration projects and about half of the 
73 community-based projects will cease receiving federal funds, 
while tnose which continue will be strengthened. Specifically, 
community-based projects serving in-school students will not be 
re-funded in FY 75. It is hoped that de-funded projects will 
either be able to generate their own resources or oe integrated 
into existing institutional efforts on the local level. 



Purpose and History of the Study 

The purpose of this study has been to evaluate the 
community-based projects, by studying a sample of 
24. The primary goal of a programmatic evaluation of this 
sort is to assess the effectiveness of the process variables 
(program approaches) in the achievement of the desired objectives 
(outcomes) . Specitically, for the commuaity-based programs, 
the primary objective is improvement of the reading abilities 
of adults and school youth. The primary evaluation tasks were 
therefore (1) to measure improvements in reading performance and 
(2) to analyze the contributions made by the various process 
and input variables towards the achievement of improved reading. 

In order to accomplish these evaluation objectives, the 
study was conducted in two directly sequential phases. Phase 
I^, the Planning Phase, was conducted from March 1, 1973, to 
September 30, 1973; Phase II , the Implementation Phase, was 
conducted from October 1, 1973, to September 30, 1974. The 
Planning Phase consisted of the conceptualization and develop- 
ment of the evaluation design while the Implementation Phase 
consisted of the collection of data and the analysis. 

In order to determine the degree to which project objec- 
tives were accomplished, reading achievement measures (tests) 
were used to assess cognitive domain competencies. (A dis- 
cussion of the problems encountered and the procedures used 
in the selection and refinement of appropriate testing instru- 
ments will be presented later.) Tests were administered on a 
pre- and post- basis. Statistical analysis of the test 
scores provided the outcome measures (or dependent variables) . 



An effort to identify the elements which contribute to 
program success involves a study of the relationship between 
the outcomes and all inputs and processes Cor independent 
variables) which may have a bearing on outcome. 

Since the publication of the Coleman Report, Equality of 
Education Opportunity, it has become increasingly clear tnat 
variation, as measured by performance on achievement tests, 
has a strong relationship not only to certain factors existing 
in schools but also to factors generally thought to be associated 
with the student. Thus two major classes of variables can be 
said to be associated with the determination of outcome var- 
iables. Figure 1 suggests a framework for viewing the rela- 
tionship of these tnree sets of variables. 



INPUT ^ 
VARIABLES^ 



PROCESS 



(i.e., ch^u:acteristics 
of the target population) 



^ VARIABLES 
(i.e., characteristics 
of the programs themselves) 



OUTCOME 
VARIABLES 
(i.e., changes in 
reading abilities) 

Figure 1 

Sincf^ theory and research have not yet led to consensus 
as to which of the possible input and process variables are 
most important m explaining output variables, our goal has 
been to identify, insofar as possiblev the optimal feasible com- 
bination of potential variables that may affect reading per- 
formance. 



Input Variables 

Relevant student characteristics usually include factors 
such as socio-economic status, family structure and stability, 
peer group membership, racial/ethnic group membership, sex, 
and age; yet more elusive student characteristics including 
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such variables as attitude towards self and life, achievement 
motivation, emotional stability, and social maturity are also 
viewed by many as highly related to reading performance. 

Understanding this, it should be clear that it is not 
always easy to define and measure input variables, especially 
the more intangible kind. Without infringing on people's 
privacy or overwhelming their powerful reticence to provide 
us with full information, it is frequently difficult to obtain 
some of the most desirable information. Thus, certain basic 
student attitudes can only be measured individually. Never- 
theless, for this particular evaluation, significant information 
about many input variables was obtained, making it possible to 
explore and analyze their outcome effects. In part:icular, 
demographic characteristics and language issues were selected 
for intensive examination* 



Process Variables 

Variables of this kind usually inclvide school or program 
attributes which are associated with outcome? for example, 
materials, instructional techniques, and organizational struc- 
tures (e.g., in-class grouping vs. individualized tutorials). 
Closely related to program variables are teacher characteristics, 
including experience, training, socio-economic background , sex , 
racial/ethnic group membership, and ability. Also, expenditure 
and attendance patterns must be examined since they too may 
relate to outcome measures. Each of these programmatic factors 
was investigated in the course of our evaluation. 

In summary, the following hypotheses provided the basis 
for our efforts: 

• That participation in the program affects reading 
achievement. 

• That reading achievement will be differentially 
related to student characteristics; and 

• That relationships exist between certain process 
variables and gains in reading achievement. 
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CHAPTER I 

REVIEW OF THE LITERATURE 



In order to place this study in perspective and provide 
a framework for the interpretation of its findings, a review 
of related research was undertaken. The purpose of this review 
was to ivientity factors which have been associated with reading 
performance in other studies. In the following pages, we will 
discuss demographic considerations, program variables, and 
special problems relating to illiteracy training. 



Demographic Factors 



A number of demographic factors have been associated v;ith 
illiteracy and poor reading. Such variables as age, race, sex, 
and geographic location are o^'ten explored in relationship to 
reading. As early as 1930, Winston identified age as one impor- 
tant variable. He found that illiterates were usually older 
people. 1/ confirmation for his findings was provided by 
several later studies. 2/ The preponderance of evidence sug- 
gests that the older group is the poorest of all age groups 
in reading skills. _3/ 

The relationship of sex to illiteracy presents a somewhat 
contradictory picture. World wide, the proportion of female 
illiterates generally exceeds that of males, often at a signi- 
ficant level, __4/ yet the National Education Association shows 
that this is true everywhere except in the United States. 5/ 
Johnson *s cross-cultural study confirms this finding, butTdds 
that Canada is also a nation where the proportion of malr 
illiterates exceeds females. 6/ Winston (1930) , Ginzberg & 
Bray (1953), Harris (1970), and the National Center of Health 
Statistics (1973)— reporting illiteracy rates only for the united 
States — consistently show a higher proportion of male illiterates 



than female. Nevertheless^ some studies contradict or minimize 
this thesis. Harris in 1971 indicated that reading differences 
based on sex are minimal^ while several studies dealing with 
specific illiterate populations have not tound significant sex 
differences relating to reading ability. 7/ Uroff found that 
during high school males make sxgnif icantXy greater reading 
gains than females. 8/ In summary^ then, it appears that for 
cultural reasons of various kinds r males in this country fare 
worse than females in the struggle against illiteracy — but not 
in all cases and in ways defying facile generalities. 

Geographic location and community-type are two other 
variables often identified with illiteracy. Generally, studies 
have shown the highest rate of illiteracy to be in the South r 9/ 
or in the South and East. 10/ Rural communities are frequently 
reported to have very higK^illiteracy rates , 11/al though urban- 
rural differences were not noted in the previously mentioned 
study of literacy cimong youths 12-17 years of age . 12/ 

Data based on racial and ethnic group membership suggest 
higher rates of illiteracy among blacks and other minorities 
than among whites. 13/ Likewise, illiteracy can often be traced 
to low income and poor educational background. 14/ 

Other factors which may be related to illiteracy are poor 
health (The National Center for Health Statistics, 1973); large 
family size CThe National Center for Health Statistics, 1973); 
and low status employment (Harris, 1971, and The Adult Perfor- 
mance Level Project Staff, 1973.) 



P rogram Variables 

For the present study, program variables are the most 
important to examine. While demographic variables give us a 
sense of what to expect from any given target population, the 
program planner can do nothing to alter such variables; they 
are static. Program variables, however, are dynamic; they can 
be modified, restructured, or redesigned in ways that may result 
in growth and improvement in literacy. 

Ma^or studies of our schools suggest that school-factors 
are not the primary determinants of student achievement . 1 5/ 
Yet investigators continue to attempt to isolate and identify 
the school and program factors which may be changed to promote 
growth in reading achievement. Much of the early literature 
on this subject compared and contrasted methods of teaching 
to determine which method might prove most effective* Signifi- 
cant differences due to method were usually not observed, how^ 
ever. Two recent reviews of research confirm that methods of 
teaching do not vary much in ef f ectiveness* 16/ Corder's exten^ 
sive study covering the ten year period 196^7 0 also concludes 
that there is no broadly based model for reading methods. Such 
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data support the view that one must look to additional factors 
to promote growth in reading achievement. 

Other factors thought to affect reading include class size 
and tne age or condition of the school plant. However, recent 
research does not indicate that these factors are significantly 
related to gains in reading. 17/ 

Some investigators have looked at the advances which 
disadvantaged students have ma^.e in test performance as a result 
of literacy training, concentrating especially on the number of 
hours of instruction necessary to achieve a certain level of 
gain. In a study of 377 disadvantaged students throughout the 
united States, the Manpower Administration noted that 208 hours 
of instruction yielded a change of approximately one grade 
equivalent. 18/ Martin and Smith reported that the gains made in 
reading programs were clearly related to the number of hours of 
instruction. They observed one-half year gain in a 100 hour 
cycle. 19/ a further study in Boston noted that systematically 
measuriEle gains in reading skills occur only after 100 to 150 
hours of instruction, although all students (even those with 
only a few hours work) were observed to make some "immeasurable" 
gainj.ao/ These studies suggest that gains in reading skills are 
only evident after at least 100 hours of instruction. 

Another area of investigation concerning the elimination 
of illiteracy has been the use of various reinforcement pro- 
cedures. Well documented in the field of special education, 
behavior luodif ication procedures have only recently been systema- 
tically attempted in adult education. Heitzman and Putman report 
considerable success using token reinforcement procedures 
with black adults in their programs. 21/ Lowther used verbal 
praise and monetary rewards to increase word recognition and 
comprehension. She noted that performance was substantially 
higher when followed by money (or money and praise) than when 
followed by verbal praise alone. Lowther cautioned, however, 
that the success of incentives may depend on their acceptance 
by teachers. 22/ Conclusive evidence in this area is clearly 
lacking and further research to determine both the long- and 
short-term effects of these types of reinforcement procedures 
will be necessary for any kind of exactitude. 

Somewhat related to reinforcement procedures such as 
those described above is the use of Computer Assisted Instruc- 
tion (CAI). Golub used CAI to teach literacy to career- 
oriented youths and noted sucess when these youths took a 
reading achievement test designed for adults. 23/ Caldwell 
used CAI and another form of programmed instruction to teach 
reading to illiterate and semi-literate adolescents. Although 
he found both procedures successful, the group favored the CAI 
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approach. 24/ CAI procedures have also been tried with student 
populations in programs such as PLATO, TICCIT and others. One 
obvious difficulty with such programs, however, is their cost 
and consequent inaccessibility to many of the wide range of 
poorer students encountered in literacy programs of this nature. 

Individualized instruction, even if not by computer, nas 
been stressed in several studies. 2^/ Also, one promising approach 
to individualization has been described by Eagleton, who used 
eleventh and twelfth grade tutors to teach sixth graders. Al- 
though no significant differences in reading achievement were 
noted between those who were exposed to tutors and those who 
were not, the older children gained significantly in self- 
concept attitude. 26/ 

Other non-reading variables have also been examined for 
their impact on reading growth. Weber, in a study of four 
inner city classrooms, identified administrative leadership as 
the key to growth in reading achievement. Administrative leader- 
ship and school climate have also been identified as key vari- 
ables in several other studies . 27/ Such empirical evidence is 
also supported by administrators. Rauch, for example, repeatedly 
stresses the importance of the administrator in developing 
effective reading programs; supporting earlier findings, he 
discounts the importance of the reading method or material. 28/ 



Classroom climate and the quality of teacher-pupil rela- 
tions have also been considered significant . 29/ Quirk and 
others are developing an instrument to be use^" in the observa- 
tion of reading instruction which focuses specifically on the 
content and mode of instruction and examines the interaction 
of teachers and students. 30/ Browne is developing an observa- 
tional system similar to fT^nder's Interaction Analysis, which 
can be used for categoriiiing and analyzing verbal interaction 
patterns during reading lessons. 31/ Hartman and the New York 
school study also identify climate as a significant factor in 
reading instruction, especially in inner-city schools. 32/ The 
variables are only now being considered for their significance 
in affecting literacy growth. Much work remains to be done. 



Special Problems 

In this section we will consider some special factors 
which contribute to difficulties in assessing the effects of 
reading programs on their students. 

One area of concern, especially with programs dealing 
with adults or out-of-school populations, is the question of 
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recruitment, although recruitment per se appears to be less 
difficult than maintaining continuous enroliment., Novak and 
Weiant mention that maintaining attendance is a problem comjnon 
to all adult basic education programs, a contention supported 
by several later studies of adult literacy programs. 33/ in 
the large scale program conducted in Boston, 14 percent of the 
enrollees dropped out after one session while fully 2b percent 
remained for less than two weeks. 3 4/ Harman cites attrition as 
a plague of all adult education programs. His survey indicates 
that an average of 25 percent dropped out in 1968 while in many 
programs the dropout rate exceeded 50 percent. 35/ Some studies 
of specific literacy programs report dropout rates as high as 
50 percent. 36/ In his analysis of student attendance in nation- 
wide Adult Basic Education programs, Osso indicates that only 
17 percent of the enrollees actually completed their courses. 37/ 
The National Teacher Training Study in Adult Basic Education 
reports high attrition rates as cnaracteristic of most ABE 
programs. 38/ 

The evidence concerning irregular attendance and attrition 
is clear. Its possible effect on the objective assessment of 
programs must also be recognized. If attrition is high, students 
are not available for post-testing and an accurate assessment of 
their growth cannot be made. Since their continued attendance 
is often erratic, it is frequently impossible to assess the 
students on their "last" day of attendance. In addition, little 
is known about the characteristics of students who drop out 39/ 
— although one study did note that a disproportionately high num- 
ber of the 16-21 year old group left early. 40/ 

Attrition among volunteer tutors was also identified as 
a problem in one study . 41/ It was reported that 34 percent of 
volunteer tutors never actually tutored, a fact wnich bodes ill 
for tne success of a program, even if other factors are favor- 
able. 

Another concern in the assessment of reading growth is 
the difference in performance exhibited by some students on 
tests involving practical applications of skills. Harris, 
using ten different kinds of activities including telephone 
dialing directions, classified ads, and applications, found 
many people reading some sections much more easily than other 
sections. 42/ Hansen and Hesse, attempting to assess literacy in 
ten distinct domains of reading (e.g., reading related to 
occupational activities, recreational activities, school-related 
activities, etc.) found significant differences in the difficulty 
levels of the material . 43/ These findings suggest that growth 
in reading ability may not occur in a uniform manner, leading 
students to perform different reading tasks at significantly 
different levels. Thus, the use of a single growth score to 
indicate overall <jains in reading may not actually reflect the 
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extent of gains made. A related problem occurs when actual 
gains made are so minor that they fall below the levels mea- 
sured by the tests. 44/ 

Yet another factor which may bias the objective assessment 
of reading growth is that few multiple choice comprehension 
tests provide sufficient guarantees against correct answers 
based on information other than that found in the passage. 45/ 
Thus, a student's score may well be an overestimate of his/Eer 
reading ability. Caylor and Sticht argue also that the format 
and instructions of typical multiple choice standardized tests 
lead to much guessing, resulting in negative gain scores 
similar to those produced by prior knowledge of information. 46/ 
The development of tests without such negative characteristics 
will be clearly necessary to overcome these problems. 

Since problems such as those described above frequently 
lead to difficulties in the accurate assessment of reading 
growth, they must be taken into consideration in any sufficient 
analysis, even if they cannot be fully avoided. 



o 
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CHAPTER 11 

METHODOLOGY 



Planning Phase 

The period of evaluation design began in March, 1973, and 
ended in September, 1974. During this phase, plans for the 
complete design were finalized* (including plans for sainpling 
strategy, instrumentation, data collection, and data analysis) . 
This planning phase began with an intensive review of the com- 
munity-based programs, including an analysis of all R2R records 
and project proposals, on-site visits to 28 projects, and the 
distribution of a mail questionnaire to all remaining projects .*'^ 

The purpose of this review was two-fold: first, to develop 
appropriate models — or "project categories" — since it was recog- 
nized that divergent structures would require different evalua- 
tion approaches? and second, to gain a thorough understanding 
of project operations and existing local evaluation procedures 
so that the final evaluation design would be both optimally 
effective in measuring performance and maximally feasible 
given actual project capability. 

Model Development and Identification 

Under the planning phase of the contract, Pacific T&TA 
was required to "cluster the projects that have common charac- 
teristics to the point that they can be termed comparable . . . 
according to those variables that are most relevant to developing 



*A full description of the plan can be found in Pacific TsTA's Evalua- 
tion Design Report, September, 1973. 

**A full description of the process can be found in Pacific TsTA's On-Site 
Report, August, 1973. 
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an evaluation design." The rationale for this approach was the 
hypothesis that the diversity of community-based projects would 
not lend itself to a single evaluation plan. 

Tne development of appropriate models was a difficult 
process. Initial ideas were established and then continuously 
refined as more was learned about actual project operations. 
These refined approaches were finally integrated into the 
finished evaluation plan itself. In the following sections, 
we will discuss the evolutionary processes we went through in 
our effort to develop the model framework most consistent with 
the nature of the community-based projects. 

As indicated in our interim report, we initially selected 
two variables for model identification: First, Reading Levels 
of the target group, defined as below fifth grade, txtth - 
ninth grade, and above ninth grade. Second, Service 
Delivery System categories — Ca) Direct Reading Programs (includ 
ing scheduled classroom, scheduled individual, and unscheduled) 
and (b) Indirect Programs (i.e., programs designed to train 
teachers and perform other auxiliary services) . Briefly, the 
rationale for this approach was that: (a) projects with differ- 
ent reading level populations would require different reading 
tests and (b) projects with different service delivery 
approaches would require different data collection procedures, 
and to some extent, different evaluation measures since their 
goals may be dissimilar. 

As specific input was gained from the field visits and 
our thinking became more refined, it became evident that the 
initially proposed models needed substantial revision. First, 
it became clear that the evaluation would be more effective if 
the number of models used was kept to a minimum, since this 
would increase the possibility of meaningful project comparisons 
Accordingly, every effort was made to structure the evaluation 
design so that it would be exhaustive enough to cover all 
project variations yet comprised of the smallest possible 
number of models. 

With this in mind, all possible variables v;ere analyzed 
to determine if they required a special evaluation approach. 
As indicated in previous reports, the two primary service 
delivery system categories (i.e., direct and indirect projects) 
remained valid as criteria, but the sub-categories (i.e., 
scheduled classroom, scheduled individual, and unscheduled) 
were not required. Revisions in the reading level categories 
were also required since the original levels we had somewhat 
arbitrarily chose . did not consistently match the level of 
the actual project enrollees. 



Our analysis of field data did indicate, hovever, thcit 
the distinction between adult/out-of-school populations and 
student/ in-school populations served as a key varia£>le enabling 
us to successfully distinguish projects on the bapis of their 
reading levels and basic program intent. 

We found that many projects enrolled students who demon- 
strated a wide range of reading capabilities and more often 
than not spanned more than one of the predetermined levels. 
This was particularly true for the projects serving junior 
high school, senior high school, and college students, while 
less true for projects serving out of school adults. 

The adult projects, in other words, were serving people 
who were reading at the lower levels while the students were 
reading at all levels, including the higher levels. As a con- 
sequence, the effort to improve reading skills required two 
different goal orientations. While adults need to read to 
achieve specific functional objectives (e.g., improve their 
economic status, gain citizenship, etc.), students need to 
read to perform effectively in school (e.g., graduate from 
high school, cope with college, etc.). 

Based upon these findings, it became clear, first, that 
adult projects had to be distinguished from student projects; 
second, that reading tests had to be found which would be 
appropriate to a wider range of reading levels than initially 
planned? and finally, that the type of tests to be utilized 
had to reflect the different goal orientations of the adult 
and student populations, in effect, we were forced to change 
the emphasis from attempts to structure models which would 
best fit specific reading tests, to identifying reading tests 
which would best fit actual project characteristics. 

With the toregoing framework xn mind, the final conceptual 
models were developed as follows: 



R2F PROJECT MODELS 



Direct Reading Projects 




3 



Adult Projects 



Student Projects 



1 



2 
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As indicated, we identified three basic models for the 
evaluation design: Direct Projects split into adult and stu- 
dent models, and Indirect Projectr- . (While the Direct Projects 
required an adult/student split, the Indirect Projects did not 
since they do not provide direct instruction to specific popu- 
lations. Accordingly, the three basic models can be defined as 
follows : 

o Model 1 — Projects providing direct reading instruction 
to adult students, who are generally reading at or below 
the fifth grade level, are not attending a formal school, 
and whose reading goals are primarily oriented towards 
improving functional capabilities. 

o Model 2 — Projects providing direct reading instruction 
to a student population (elementary school, junior high, 
senior high, or college students) whose reading levels 
range from below fifth grade to above tenth grade. 

o Model 3 — Projects that do not provide direct reading 
instruction as their primary purpose, instead providing 
indirect services such as the training of teachers, the 
provision of reading materials, etc. 

These models were based upon the act'ial prograitu-iatic 
situation during FY 73. Discussions with the Office of Plann- 
ing, Budgeting, and Evaluation (OPBE) , however, indicated that 
the evaluation should cover only those projects providing 
direct reading instruction. Accordingly, the evaluation 
design was developed to encompass only direct reading projects ; 
i.e.^ Models 1 and 2 . This modeling approach enabled us to 
develop a plan that was the same tor both student and adult 
projects, with tne exception of the reading tests to be 
utilized, thereby facilitating the possiblity of inter-mode] 
comparisons while simultaneously not obscuring the variations 
among projects. 



Sampling Strategy 

The evaluation design proved to be applicable to the 
entire universe of community -based pro3ects. However, OPBE 
decided to conduct the evaluation only among a sample of 
projects, given budgetary constraints and the pilot nature of 
the study. Accordingly, 24 sites were randomly selected via 
a stratified cluster design (with all students in each sampled 
project to be included in the study) , from the universe of 69 
direct service projects in operation in FY 74. The stratifica- 
tion design included the primary split between student and 
adult projects and secondary subdivisions into ethnic strata. 
Project ethnicity was defined by the majority ethnic group 
being served, with the "mixed" category representing any 
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project that did not serve a majority of any one ethnic grour>. 
Table 1 presents the stratification design. Based upon FY 74 
enrollment figures, it was estimated that the sample would 
include approximately 1400 students from an estimated universe 
of 5200 (27%) and 1000 adults from an estimated universe of 
3700 (33%). 



Table 1 

Stratification of Projects by Ethnicity and Model 



ETHNICITY 



Hi 



Black White Spanish Mixed Total 


Adults 


7 

6 / 
2 


3 / 


15 / 

/ 5 


' / 


30 


Students 


L9 / 


I / 
/ 1 


11 / 


7 / 

/ ^ 


39 / 


Total 


25 / 

/ 

/ . 


5 / 

7— ' 


26 / 
/ 9 


/ 

/ 

4 


69 / 
/ 24 
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It should be noted that in some cases student projects* 
may have served a small number of adults, and adult projects 
may have served a small number of students. In the cases 
where no specific project component was established tor this 
subgroup, variation in the evaluation design was made. Two 
student projects, however, (Projects K & G) had separate 
adult program components. For these two projects, the adult 
components were treated separately. 

Instrumentation 

A variety of instruments and data collection forms were 
utilized in the study. The following is a discussion of the 
purpose and content of these instruments. 

Reading Tests» -Standardized reading achievement tests 
were used on a pre- and post- basis to assess cognitive per- 
formance. An extensive review and selection process was 
undertaken to identify the most appropriate tests for the 
student and adult projects based upon three primary criteria: 
the nature of the tests, the nature of the programs, and the 
purpose of testing. 

{!) Tests were evaluated on the basis of the guidelines 
established by the American Psychological Association 
in its Standards for Development and Use of Educati c/^al 
and Psychological Tests J These incnuded type of tec j.7~"leve i 
and range, cost, administrative procedures, scoring, test 
interpretation, time limits, reliability, validity, suit- 
ability, timeliness, and availability. 

(2) Student projects were characterized in terms of: 

• Program Goals — To prepare students for success in 
school by improving their reading skills and 
attitudas. 

• Range of Levels — Reading grade levels in any one 
project may include a span of five or more years. 
The reading level of most is well below their actual 
grade level. 

• Participant characteristics — The participants are 

of elementary to college age and most are members of 
minority groups. They have generally been unsuccessful 
in school. 

The type of test needed for this group is one that measures 
general school-related reading skills, but not necesnarily 
of the same format and style as traditional school tests. 



It should not include material judged to be inappropriate 
or irrelevant. It should have face and content validity 
for both staff and students. It should cover a wide 
range of reading levels either within a single test or 
among different levels of the same test. 

(3) Adult Projects were characterized in terms of: 

• Program Goals — To prepare adults for their daxly life 
activities by improving their functional reading skills. 

• Range of Levels — Reading grade levels are generally 
very low. Many adults are considered illiterate or 
semi-literate. Some are non-English speaking. The 
range in this group is not as wide, however, as in 
the school group. 

• Participant Characteristics — The participants are 
adults no longer in formal school programs. Some 
speak English as a second language. 

The type of test needed for this group is one that measures 
functional or practical literacy. It should portray its 
content in an adult oriented, non-school format. It should 
cover real life activities. It should include a range 
easy enough to avoid frustration, yet remain challenging 
in a meaningful way. It should have face and content 
validity for both staff and students. 

Finally, tests should be selected that can successfully 
satisfy the primary intent of assessing reading performance 
for evaluation purposes. 

Given the above criteria, tests for both student and 
adult projects were analyzed as indicated in Tables 2 and 3. 
The SRA Multi-level Achievement series was selected for 
the student projects for the following reasons: 

Its four different tests cover a range from fourth 
through ninth grade. Normative data are provided 
from first to twelfth grade for the general popula- 
tion and for a special sub-sampel of Title I schools 
(which nave po^julations similar to the R2R in-school 
populations) . Its format and content are appealing 
to all types of students. It would probably be a 
new instrument to the students and the projects, a 
factor which would no doubt be welcome. The over- 
lapping of items and questions among levels makes it 
desirable for use in projects with a broad range 
of achievement levels. Its wide span would enable 
us to secure a score for even the slowest students, 
and its reliability is»76. 



The Reading Everyday Activities in Life Test (R/EAL) 
was selected for the adult project for the following reason: 



It was specifically designed for adolescents and 
adults. It includes subject matter suitable for 
adults that is representative or practical and real- 
life material. Its cassette form of presentation 
makes it easy to administer individually or in groups 
and presents; a motivating factor in the test taking 
process. It yields information about an individual's 
performance on tasks directly related to functional 
literacy, a major goal of the adult progrsuns. Al- 
though it has not been used on a wide-scale basis, 
reliability and validity data on samples of over 
600 point to the soundness of the instrument. One 
drawback is that at present no alternate or equiva- 
lent form exists. Such alternate form is desirable 
but not essential. Finally, it is applicable to per- 
sons with very limited reading skills and the instruc- 
tions are available in Spanish. 
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Tabic 2 
Scale of Acceptability 
-Student Tests-- 



BtST COPY AVAIUBLE 





CRITERIA 


TEST 


1 


Level 


Cost 


c 

u 
4J 

G 


Scoring 


Interpretation 




Reliability 


Validity I 


Suitability ! 


> < 
f 

• ^ , 

k 


0 

>i ^ 
P p-i 
H • 

H o <■ 
H c • 

(\J fT 
r4 V< 

iU u 

< <X 


0 
M 

>. 

M in 
-t c 

-i 4^ 

a* 


Basic Readinq Hate Scale 






ni 




4 


4 


4 


ni 






4 






Brief Test of Literacy 






ni 




4 


- 


4 






- 


4 






CAT 


+ 


+ 


+ 




4 


4 


4 


- 


- : 


4 


4 


4 




CTBS 










4 


4 


4 


4 


4 


4 


4 


4 


4 


Cooperative English Test 


+ 


- 


ni 


+ 


4 




4 


4 


4 




4 






Criterion-Referenced SWA 


+ 


- 


ni 


+ 


4 


ni 


ni 


ni 


ni 




«- 






Davis - 1961 


+ 


- 


+ 


+ 


4 


- 


4 


4 


4 




4- 






Essential Reading Skills 


+ 


+ 


ni 


+ 


ni 


4 


ni 


ni 


ni 




^ 






FAS 










4 




4 


4 




- 


4 






Gates McGinitie 




+ 


+ 




4 


- 


4 


4 


- 


- 


4 






Individual Readinq Placement 




+ 


+ 




ni 


ni 




- 




- 


4 






ISRT 


+ 




+ 


+ 


4 


4 




4 


4 


- 


4 






lOX 


+ 




+ 


+ 


4 












4 






McGraw-Hill 








4 


4 


4 


4 


4 


4 


4 


4 


4- 


4 


Metropolitan Achievement 










4 


4 


4 


4 


4 


4 


4 


4 


— 


Nolson-Donny 










4 




4 


4 


ni 


4 


4 


4 




Nelson 


+ 


+ 


+ 




4- 




4 


4 


ni 


4 


4 


4 




Freer iptive 










4 




4 








4 






SRA Achievenient 




+ 


+ 


+ 


4 


4 


4 


4 


4 


4 


. 4 


4 


4 


Stanford Achievement 










4 


ni 


4 


ni 


ni 


4 


4 


4 


4 


TASK 


4- 








4 


ni 


4 


ni 


ni 


4 


4 


4 


4 


Test of Individual Meeds 










4 




ni 








4 






Carver-Darby 










4 




4 








4 










4- 


ni 




4 


4 


4 






4 









Keys 4 » acceptable 

<- * unacceptable 
ni • no Information 
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Table 3 

Scale of Acceptability 
-Adult Tests- 

CRITERIA 





Type 


Level 


Cost 


1 

c 

CO 


Scoring 


Int erpretat ion 


0) 

$ 


Reliability 


Validity 


j Suitability 


1 Availability 


o 

N CO 

^ Q 
Q 

3 B 
O 

H U 
H tl> 

04 0 
04 U 
< P4 


Applicability to 
Participants 


ABESS 






+ 






+ 
















ABLE 


+ 






+ 






+ 


4- 


4- 


+ 


+ 




4" 


ABRI 




+ 


+ 


+ 














4" 






Am. Literacy Test 


+ 




ni 




+ 






ni 


ni 




ni 






BOLT 


+ 


+ 


ni 


ni 


ni 


ni 


ni 


ni 


ni 


ni 








Cairver-Darby 


+ 




+ 


+ 


4- 












+ 






Davis - 1973 






ni 




ni 


ni 


ni 


ni 


ni 










Informal Reading Inventory 




+ 


ni 




ni 


















NAEP 


+ 


+ 


ni 




+ 


4- 


+ 














R/EAL 






+ 






+ 


4- 


4- 


4- 


4- 


4- 


4^ 


+ 


RBH - Reading 






+ 


+ 






+ 














SRA Readincr Index 


+ 


+ 




+ 


+ 


4- 


4- 




4- 


4- 


+ 




4- 


Survival Literacy Study 


+ 


+ 


ni 




+ 




ni 














TABE 


+ 


+ 




+ 


+ 




4- 








4- 






Wisconsin ABE 






ni 


4- 


ni 




+ 






4- 


4- 


+ 





Key: + ■ acceptable 

- m unacceptable 

^ ni « no inforoation 
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Attitude Scale — A secondary objective of the Right to Read 
program is the improvement of attitudes toward reading. This 
is based on the assumption that positive attitudes towards one- 
self as a reader — and towards reading as a desirable, pleasurable, 
or necessary activity— will motivate a person to want to learn 
to read and that this motivation will in turn result in improved 
reading performance. (This relationship is, of course , reciprocal. 
Motivation, however, as a highly subjective internal drive 
complicated by numerous other factors relating to past and 
present experience, cannot be assessed in the direct manner 
possible for more external performances of skills. When such 
assessments are attempted, though, the methods generally used 
include: identifying and measuring all actions of the indivi- 
dual which appear to be clearly related to reading attitudes 
asking the individual to complete questionnaires which provide 
subjective, personal reports about his/her attitude or under- 
standing of his/her motivation toward specific goals? and pro- 
jective tests. The latter have been eliminated in the R2R 
program as impracticable, since they require individual adminis- 
tration by highly trained testers, and since they are excessively 
dependent upon speculative inferences. The first two approaches 
— measurement ot direct behavior and self-reports — were, by 
contrast, extensively explored. Specifically, thirteen tests* 
were identified and analyzed in detail, based on the following 
criteria: 

1. Their value for adult and student populations. 

2. Their amenability to administrative procedures 
required for non-readers or non-English speaking 
persons . 

3. Their amenability to group administration. 

4. The simplicity of their administration and scoring 
procedures. 

5. Their cost. 

6. The extent to which their content is relevant to 
the measurement of reading attitudes. 

7. Their overall reliability and validity. 



*A full report on each of these tests is available from Pacific T&TA. 



Whxle several tests seemed promising in relation to some 
of the criteria, there were none which satisfactorily met all 
criteria. Thus, the best of the tests proved to be measures 
of self esteem in general with little applicability to the 
specific arec. of reading attitudes, while the only really 
possible test of reading attitudes (The Attitude Scale by 
Thomas H. Estes) was developed for children and contains many 
Items inappropriate tor adults. We therefore decided to con- 
struct a simple test of our own, based on the following under- 
standing; 

1. Measuring attitudes toward reading is our only real 
concern, and none of the existing scales are adequate 
to fulfill this function for the R2R population. At 
best, a complex battery of existing tests would be 
required. 

2 . Existing tests are generally non- standardized (or 
standeardized only for very small populations) so we 
lose little m this regard by devising our own non- 
standardized test. 

The original scale of 30 items developed by Pacific T&TA 
was pre-testea twice s on a population of 90 disadvantaged 
high school students, and on a group of adult illiterates. 
Basing our decision upon test results (which indicated a split 
half reliability of .87) we reduced the test to the 25 most 
discriminating items. 

Since it did not seem reasonable to assume that attitudinal 
change could be measured in a 4-6 month period, it was decided 
to use the test on a once only basis. Further, in order to 
minimize the burden on the projects, it was decided to test 
only a sample of two student and two adult projects. These 
sample projects were randomly selected from those which demon- 
strated a wide range of reading skills (based upon pre-test 
scores) and had at least 100 enrollees. 



Student and Staff Data Forms ; The student and staff data 
forms were designed to secure baseline and termination data on 
important student and staff variables. Characteristics to be 
included in the forms included those identified as potential 
differentiators of performance based upon the results of 
related research. Areas of inquiry on the student data form 
included: 
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Demographics— age, sex, ethnicity, grade completion, 

employment status; 
Reasons for enrollment and date of enrollment; 
Language and reading skill data; 
Instruction plan; 

Termination date and reasons for termination. 

Areas of inquiry on the staff data form included; 

Demographics— aye, sex, ethnicity, grade completion; 
Teaching experience; 
Job assignment; 
Language data; 

Termination date and reasons for termination. 



Attendance Data Form— Because it was assumed that attendance 
patterns ana the amounts of instruction actually received would 
m5 f^^ performance, the attendance data form was used to collect 
montnly attendance data on all students. This form included 
monthly data on the number of sessions attended, the number of 
sessions not attended, and the total number of instructional 
hours per month. 

. Staff Questionnaire— As an additional source of input about 

d^v^?^^ J^^'^r^?''? ■ effectiveness , a staff questionnaire was 
developed and utilized. This questionnaire was pre-tested at 
a non-samplei R2R site, then revised and finalized. Areas of 
inquiry included 25 items relating to administration and organi- 
zation, the staff, students, and the instructional program. 

On-site Observation Guide— Part of the evaluation required 
the document:ation and description of actual classroom and 
tutorial situations. In order to systematize our observations, 
It was decided that a standard observation format would be 
needed. Several existing observation instruments (such as the 
SRI observation instrument) were reviewed for their applicability. 
This review indicated that none of these instruments were tail- 
ored to meet our needs, either because they were not designed 
to observe reading programs or because their complexity was far 
beyond the scope of this particular study. Accordingly, we 
developed and pre-tested our own form (utilizing inter-rater 
reliability checks). Our guide enabled observers to systema- 
tically document instructional processes including: The pat- 
tern of instruction, the iorm of instruction, style and content, 
and materials used. 
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Proi ect Interview Guide— Finally . we used a project inter- 
view guide to enable field staff to interview project directors 
and staff and obtain needed data on; 

Project characteristics, agency type, nature and 
location of project, recruitment approaches, pro- 
ject operations, service delivery system charac- 
teristics, materials, related services, training 
and technical assistance, and budget and staffing 
allocations. * 



ImpTementat'ton Phase 

Actual implementation of the study commenced in October 
and data was collected from the last week in November until 
the last week in May. Start-up activities, data collection, 
and analysis activities occurred as follows: 

Advisory Panel Meeting 

Pacific T&TA organized and convened a four member advisory 
panel to review and critique the planned evaluation procedures. 
The panel's initial meeting was convened for two days in Novem- 
ber at which time final revisions were made in the procedures. 
Based upon this review, all forms and procedures were finalized 
and submitted to 0MB for clearance. 

Start-up Activities 

During October and November, all logistics required for 
the pre-test period were developed and implemented: Pacific 
T&TA notified the projects of the evaluation plan, established 
pre-test dates, and requested enrollment figures to determine 
how many test forms each project would need. SRA and R/EAL 
tests and testing instructions were ordered and then shipped 
to the projects in sufficient quantities. An exhaustive eval- 
uation instructions manual was also mailed to the projects. 

Staff Training 

A three day training session for the six person field 
staff was neld. Training was given by the Project Director, 
Assistant Pro3ect Director, and a member of the SRA testing 
staff. Tne training covered a full review of the evaluation 
plan and instructions manual, the test administration proce- 
dures, use of the interview guide, and most importantly, over- 
all strategies for insuring cooperation and rapport with the 
projects. 



*A copy of all instrxjments used can be found in tlie appendix. 
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Pre-Test Period 



Eight staff members visited all 24 projects from November 
26th through December 14th at which time reading pre-tests 
were administered to all students in attendance during the 
course of a one week visit. During these visits, we monitored 
the testing and distributed and explained the evaluation 
manual. In many cases, the project did not test all their 
students during this visit due to varying levels of absentee- 
ism. As indicated in the evaluation instructions manual, 
however, the projects were requested to pre-test those students 
who were absent as soon as possible, as well as pre-test new 
students upon their enrollment. Additionally, the project 
interview guide was completed and a roster of all current 
students was obtained. A few of the projects were not yet in 
operation (or on semester break during this period) and so pre- 
testing was delayed and completed later. When the visits were 
completed, our staff members held individual briefing sessions 
with the Project and Assistant Project Directors covering all 
aspects of the visits. 

Student, Staff, and Attendance Data Form Collection 

Upon approval from 0MB in January, the student and staff 
data forms were mailed to the projects. Student data forms 
were pre-named and pre-coded based on the previously received 
rosters. Projects were instructed to mail in forms for all 
current staff and enrollees by February 1, and to mail in forms 
for new staff and enrollees (and terminees) on a bi-monthly 
basis through May 31. 

The forms were printed with triplicate carbon inserts 
so that projects could file one copy and the other copies 
would be for enrollment and termination recording. Pre-named 
and pre-coded attendance data forms were mailed to the projects 
on a bi-monthly basis for their completion and submission to 
Pacific T&TA. 

Following dissemination of the forms, we maintained con- 
tinuous and frequent contact with the projects, to help maximize 
receipt of ail data forms and test results. "Prod" letters were 
often mailed requesting data missing for any individual. Also, 
frequent phone contact was made to help with problems, to 
identify additional materials needed, and to cover future plans. 

Qn-Site Observations 

During February, dates were established for the on-site 
observation visits. Field staff training sessions were held 
once more, at which time the on-site observation form was 
reviewed and simulated classroom/tutoring sessions were used 
to practice use of the form. The on-site observations were 
made in March and April, at which time staff members visited 
each project for three days. The field staff observed as 
many separate classes and tutoring sessions as possible within 
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this period. Briefing sessions were held with each staff 
member upon his/her return to review forms and discuss 
findings. 

Post-Test Period 

Procedures for the post-test period were essentially the 
same as for the pre-test period. However, longer post- test 
visits were made at those projects which experienced difficulty 
during the pre-test period. In order to ease the burden on 
the projects during the post-testing, we mailed them pre-named 
and pre-coded SRA answer sheets and R/EAL booklets for all 
students to be post-tested (i.e., those who had taken the pre- 
test and had not terminated). During the post-test period, 
the staff questionnaires were distributed (with self-addressed 
return envelopes to protect confidentiality) ; missing data 
forms and attendance data were requested? and the attitude test 
was administered at the four sample sites. 

Data Processing and Analysis 

Pacific T&TA maintained an extensive and systematic manual 
and computer processing operation to maximize the quantity and 
quality of our data. As test answer sheets and booklets were 
received, they were manually scored. Keypunched, verified, and 
stored. Scores were then mailed back to the projects for feed- 
back purposes. All data forms were manually edited and then 
keypunched and stored. All data received was "logged" in our 
manual rosters, enabling us to identify missing data on an 
individual basis. Projects were notified of any missing data 
and were requested to supply this information. Data collection 
activities ended May 31, at which time data files were finalized 
for subsequent analysis. Computer print outs on ail inc'ividuals 
were then checked against Pacific T&TA manual records. Computer 
processing was completed in July, at which time the anlaysis 
itself was undertaken. A full description of our analytical 
procedures will occur in subsequent chapters. Finally, the 
advisory panel was re-convened during August to review progress 
to date and finalize the analytical plans. 
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CHAPTER III 

CRITIQUE OF THE EVALUATION PROCESS 



The complexity and scope of this study within the diver- 
sity of the ccxununity-based programs resulted in variations, 
problems, and unintended benefits for the evaluation, in our 
effort to put this evaluation process in perspective and iden- 
tify issues that may affect future research, we have here 
assessed what we consider to be the primary positive and nega- 
tive aspects of the evaluation process. The following are the 
major categories we have ex2imined: project responsiveness, 
project/evaluator relations, testing procedures, and data form 
and questionnaire utilization. 



Project Responsiveness 

In general, the projects' response to the evaluation pro- 
cess was outstanding. This is particularly true given the 
rigorous and time consuming nature of the study and the fact 
that the participation of each project was for the most part 
voluntary. Specifically, most projects proved to be capable 
of effectively responding to all evaluation requirements. 
While initially the system was somewhat confusing, ultimately 
they fully understood the process. The willingness of the 
projects to cooperate was especially rewarding to us since no 
written official sanction was given from the national R2R 
office and since the student projects recognized that this was 
their last year of funding. 

As expected, however, some of the projects were not able 
to fully respond to the evaluation requirements, primarily be- 
cause of internal programmatic difficulties. Project" r" for 
example, experienced almost a complete programmatic shift in 
the course of the evaluation. Initially, its primary component 
was the utilization of one-to-one volunteer tutoring at students' 
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homes. The secondary component was English as Second Language 
(ESL) classes. However, the one-to one tutorinq component was 
in a state of disarray, which was fully recognized by the project. 
The Project Director explained this as follows: 



"These problems were recognized as critical at the time that 
the National Right to Read Office informed the project staff 
that tha ... Right to Read I Project "R**) was to be one of 
the comnunity-based sites to be evaluated by Pacific T&TA 
Corporation. Part of this evaluation included the use of a 
new R/EAL test for functional illiteracy. An on-site evalua- 
tion from a PTSTA team member administering the test revealed 
that many of the students, once in the reading program, could 
not be located later and that a smaller number of students 
actually were being sexrved. 

The recognition of this •'cry basic flaw in the program 
may well reverse the impact of the program. 



Problems were faced by other projects as well. The basic 
philosophical orientation of Project '*S" made them wary of the 
overall evaluation and testing process and thus limited their 
willingness to cooperate fully. Project "H" suspended opera- 
tions for several months due to delays in funding and to the 
switch to daylight saving time net*r jcitated by the energy 
crisis (this project operatts at "7^30 am). As a result the 
pre- and post-test periods were substantially shortened. 
Project "G** terminated its initial program during the course 
of the study, and full operations with new students did not 
begin until Fe£>ruary. Project "D" was on semester break until 
February, at which time pre-testing revealed that most of their 
students received such high scores on the SRA test that post- 
testing for these students would have been meaningless. Finally, 
the overwhelming cultural differences present at Project "Q" 
limited their capacity to respond fully, while to some extent 
the evaluation objectives were incompatible with their local 
goals. 



Project/EvaTuator Relations 

The projects' positive responses, we felt were due pri- 
marily to their own initiative and to the positive relations 
and communications we established with them. We purposely 
made sure never to threaten th^ projects or dictate demands to 
them, tnus mitigating the innerent conflicts between the 
programrter and the evaluator. Additionally, we made every 
effort to make their jobs easier by using devices such as pre-naming 
and pre-coding forms, by answering all of their questions 
immediately and fully, by requesting that they call us collect 
whenever problems aroce, and by providing test result feedback 
for all of their students. 
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Testing 

The use of the SRA reading achievement series for student 
projects and R/EAL for adult projects generally proved to be 
effective. The projects found the tests easy to aiminister 
and we found them easy to score and process. The use of the 
Evaluation Instructions Manual and Testers* Manuals provided 
the projects with readily available answers to their questions 
as they arose. The multi-level nature of the SRA proved val- 
uable in testing the broad range of skills represented by the 
students (except for those having initial skills equivalent to 
grade 12 or above) . The availability of taped instructions 
and transcripts in both English and Spanish enabled the projects 
to use R/EAL in both classroom and individual situations and 
the format was consistent with the goals and materials being 
used by the adult projects. 

Because ot the diverse nature of the projects, however, 
procedural problems in testing did arise. First, the initial 
goal of testing all students in one week proved unrealistic 
for many projects since attendance is often sporadic. This 
resulted in a shorter than hoped for pre- and post-period for 
many students. 

The length of time needed to take the tests in some cases 
necessitated prolonged test-taking over the course of more than 
one session. Moreover, the R/EAL test proved too difficult for 
a substantial number of illiterate adults during the pre-test, 
resulting in either a partial test score or no score at all. 
Partial test scores were adjusted through regression analysis, 
while no scores because of inability resulted in the assign- 
ment of a score equal to the lowest 10 percent of the distri- 
bution. (This process is further explained in the analysis 
section. ) 

The most difficult problem, however, which affected not 
only the evaluation process but the effectiveness of the pro- 
jects themselves, was student attrition. 

In* terms of testing, attrition (1) resulted in a large 
body of missing test data, and (2) limited the number of 
students for whom pre- and post-tests were available. Table 
4 presents these ccanpietion rates for all projects based upon 
enrollment figures vs. pre- and post-tests received. The 
implications of high termination and attrition and their effect 
on test results are more fully discussed in the analysis chap<:er. 
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other Forms and Instruments 



The utilization of the student, staff, and attendance 
terms proved to be extremely effective in obtaining required 
data. For most projects, we received data forms on all stu- 
dents and staff J and attendance data, which represented a time- 
consuming taisk tor the projects, was usually submitted completely 
and on time. Termination forms were slightly more difficult 
to control, however, since the attrition process itself was large- 
ly uncontrollable. However, accurate termination data was ulti- 
mately received as a result of special efforts to locate indivi- 
duals and through personal contact with project personnel. 
Both the staff questionnaires and attitude scale were easily 
administered by the projects. In a tew cases, however, the 
response rates to the staff questionnaire were low because staff 
members were finishing their school jobs at the time of adminis- 
tration and by the time we became aware of missing data it was 
virtually impossible to contact them. 

Finally, the on-site observation guide proved to be a 
valuable tool in documenting instructional activities. Its 
only limitation was that we were able to observe only a small 
sample of one-to-one tutoring situations at projects utilizing 
this approach. 
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CHAPTER IV 

PROJECT CHARACTERISTICS 



In the course of the evaluation we collected data on 
several aspects of project operations: overall project struc- 
ture and characteristics, service delivery mechanisms, instruc- 
tional patterns, enrollment patterns, and budget allocations. 
These data were collected during on-site visits and through fre- 
quent phone contact (and recorded on the Project Interview 
guide and on-site observation forms) . We have summarized these 
data xn order to present a c-ipsulized view of the 13 student 
and 11 adult projects studied, and have drawn some general 
conclusions about the projects' overall operations. 

In this chapter we will discuss organizational and program 
characteristics. In subsequent chapters we will discuss enroll- 
ment patterns and budget allocations. 



Organizational and Program Characteristics 

Prior to a discussion ot the objective and quantifiable 
characteristics of these projects, it is important to provide 
our subjective impressions of their relationship to the Right 
to Read Program and participants. Without exception, we can 
report that the projects and their staff members demonstrated 
a remarkably deep and personal commitment to the Right to Read 
goal of eliminating illiteracy; this was evidenced in their 
attitudes both towards their project goals and towards their 
students. The staff members of the projects believed in their 
local efforts, worked hard at accomplishing their objectives, 
and for the most part were advocates and sensitive supporters 
of their students. In sum, they were dedicated to improving 
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their participants' reading skills and believed that hard work 
on their part could accomplish this goal. Obviously, there is 
no means of quantifying this sense of dedication (and including 
i i" '^"^^ nevertheless represent, an accomplish- 

ment which should be recognized and applauded. 

It should also be mentioned here that this study did not 
attempt to evaluate the administrative effectiveness of these 
projects xn any formal way. Instead, project effectiveness 
must be judged in terms of the reading outcomes discussed in 
later chapters. 

The remaining sections of this chapter are based on our 
findings as presented in Tables 5-8. Table 5 presents a summary 
frequency count of major project characteristics for both models; 
Table 6 presents a frequency count of the reading materials 
utilized, and Tables 7 and 8 present individual project data 
on service delivery and instructional pattern characteristics. 

Agency Ty pe 

^ types of agencies—four year colleges, junior colleges, 

community organizations, and public libraries— operated the 24 
sample projects. For student projects, the predominant agency 
was the four year college, which operated 10 of the 13 sites, 
with one junior college and two community organizations account- 
?^ remaining sites. Of the eleven projects oper- 

ated by colleges and tiniversities, four actually serviced their 
own college constituency while seven served elementary and 
secondary school populations. Of those serving the latter group, 
actual administration and instructional operations occurred at 
the local school for three of the projects and thus participa- 
tion by the IHE was limited. For example, while Project "H" was 
the grantee agency, all project operations were located at a 
local high school '♦west campus" and all instructional staff were 
regular high school teachers, in effect. Project •*H's'* only 
participation occurs at the level of financial control and 
accountability. This somewhat cumbersome and inefficient two 
level structure evidently resulted from legislative constraints 
which prevented direct funding to LEA's for community-based 
operations . 

For the adult projects, the predominant agency was the 
community organization, wnich operated seven of the eleven 
sample sites, with the remainder operated by IHE and one 
library. 

The fact that educational institutions primarily serve 
students while <ffnunity organizations primarily serve adults 
should not be r ^ * -islng. It suggests that established 
educational ac;^. 3 are more comfortable participating in 
traditional exrangements , primarily because of their limited 
experi^ricef ^vi^ith. the community as a whole and with adults. 
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Community organizations, on the other hand, as the primary 
adult agencies, have had considerably more experience in 
serving out of school, adult populations. 

Form and Location of Instruction 

The primary form of instruction for the student projects 
is scheduled classes, accounting for 11 of the 13 sites, with 
the two remaining sites using tutorial instruction. Their 
almost exclusive use of scheduled classes results from their 
institutional structure (which is built upon this learning 
approach) and from the fact that many projects are extensions 
of the regular school curriculum. The adult projects use 
individual tutorials and scheduled classes almost equally, 
either out of necessity or for more flexible organizational 
structure. 

The location of instructional services is closely related 
to the form of instruction. For the student projects, instruc- 
tion occurs at the LEA, college, or community center; and in 
all but one case only one or two locations are used. This 
limited number of sites per project reflects the fact that 
students are readily available for instruction because of their 
attendance at their regular schools, and thus outreach centers 
are not required. For the adult projects, on the other hand, 
multiple locations are typical, utilizing community centers, 
colleges, homes, or a combination of these facilities (with 
individual homes only used in one-to-one tutorial situations) . 
The number of sites range from 3 to 40 locations per 
project. 

Tne different goal orientation ot scheduled classes 
vs. individual tutorials results in substantial operational 
differences. The class form of instruction relies more on 
a traditional group remedial approach primarily utilizing 
professional staff, while the tutorial form of instruction 
focuses more on outreach and individualization utilizing 
professional, paraprof essional, and volunteer staff. The 
organization and administration of classroom projects is a 
less difficult coord inative task than tutorials: Classroom 
projects are operated in only a few locations; students are 
assigned to a specific limited number of teachers; classroom 
hours are regularly scheduled? and thus overall coordination 
among administrators, staff, and students is relatively 
easily accomplished. Individual tutorial projects, on the 
other hand, are faced with a complex se<fe of organizational 
tasks. First, tutors have to be recruited", trained and main- 
tained in sufficient quantities to service the population; 
students and tutors must be matched; individual times and 
places for instruction must be established and in many cases 
either tut >rs or tutees must travel long distances to parti- 
cipate; and rematching must take place when a tutor or tutee 
terminates. In summary, then, the basic nature of cias/sroom 
projects inherently facilitates relatively structured, ^r^ore 
easily organized efforts, while tutorials require more sophis- 
ticated and complex organizational approaches. 
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Time of Instruction 



The time of instruction indicates important variations 
among the student projects. Basically, they can be categorized 
as either during the regular school day, prior to school, or 
after school. Those projects which operate during the school 
day have usually integrated their efforts into the regular 
school curriculum, so that Right to Read serves as a replace- 
ment for other activities. Those projects which operate before 
or after school provide reading instruction in addition to the 
regular school offerings. 

Given these definitions, five student projects can be 
said to operate during the school day while eight projects 
operate outside the school day. This distinction is irrelevant 
to the adult projects since adults do not attend other formal 
educational institutions. 



Staff Structure 



are hiSfl^rS?!^!^^ ^fJV . substantially among projects, and 
are highly related to thexr forms of instruction. All Droi<:>ctc: 

Srcler?cai^^L?f^^^'°f and sometimes a back-up^^dministraJfve 
or clerical staff? instructional staff include paid orof ton a i 

an25of ^' l^^t^^ specialists, paid tutor s--usua?iy coJfegl 
and/or work study students— and volunteer tutors. ''''^'■^^^ 

For instruction, the student projects orimarilv tit-n-jTo r.= -!r» 
professionals (sometimes backed u| 4 Pald^orvoiiSteer'^SIo^^K 
The adult projects use more varied structures including 
paid professionals, paid tutors and volunteer tutors. 
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The potential trade-off between volunteers and profession- 
als (aside from costs) is that volunteers are usually indigenous 

feS^ion^? ^^^^^^y establish rappSri whiJe pro- 

fessionals have higher levels of teaching skills. 

School Credit and Recruitment Approaches 

t^K^i the 13 student projects 

while it is available in only one of the 11 adult projects 
once again reflecting the different institutional characteristics 
Of the two models. As a consequence, many of the student 
projects have built-in attractions (since participation in the 
project meets an existing school requirement) while those 
px-oDects without school credit are likely to reflect more 
voluntary decisions to participate. 

Recruitment approaches also reflect the degree of volun- 
tary participation. Existing approaches include referrals, 
required participation, general promotion and publicity, and 
special incentives such as stipends. Student projects rely 
S^o^i ? ^""'^ referrals, and general publicity, while adult 
projects rely primarily on publicity, only secondarily using 
referrals. Referrals for the student projects typically 
come from school counselors or teachers who identify students 
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fn??.^''ti;^i''r^'^^^^ ^^^P- ^^^^ ^^"^ referral process inher- 
ently includes a strong degree of compulsion, since the student 

Re'f^rrais'for'Leldufr^' T''"^ ciecisforto'pLtlc^^ate. 

^^^^^^ projects, on the other hand, are likely 

and ar^ ll^ community agencies or local gove;:nmental agencies^ 
compulsion ^ service to the participant than a forS of 



Related Services Provided 

r-^ z,-"*^®^ projects offer supplementary services in addition to 
reading instruction. These services (such as counselling ser- 
vices, health referrals, and recreational activities) tend to 
De ot an informal and limited nature. A few exceptions 
do exist. For example. Project "P", offers a full 
range of recreational activities built into the program struc- 
ture; whereas Project "J" provides eye exams for all parti- 
cipants. t"*^^* 

Materials Utilized 

The projects were asked to rank the frequency of usage of 
in tHiI q Si-^^- results of their responses are presented 

m Table 9. While most of the projects utilize a variety of 
materials, in most projects only a few are used extensively, 
m oi^^''''^^''^^ use teacher-prepared materials and workbooks 
o^f^ frequently, while student projects use workbooks, teacher- 
prepared materials, and high interest/low vocabulary books 
^?rlA ^f^^""' ,7^® frequent use of teacher-prepared materials 
evidently reflects the assessed lack of existing remedial 
materials, particularly for adults? and the use of high interest/ 
In);; ^°'=^ft>uiary readers by the students suggests that their read- 
ing skills are more advanced than those of the adults, enabling 
them to use books m place of less advanced materials. 

ESL Components 

ESL Components are defined as specific and organized 
pro:iect efforts to teach oral English skills to non-English 
speaking participants. When ESL components are available thev 
tlfr.'^T'^^l^ designed to deliver oral skills to participants 
^.^f^ V^k""? reading instruction begins. In some cases, how- 
ever, both forms of instruction are provided simultaneously. 
Given this definition, three of the 13 student projects can be 
said to have ESL components, while four of the li adult proiects 
have ESL components. Only projects using classroom structures 
have ESL components. The absence of ESL instruction in tutorial 
projects evidently results from the difficulty of identifying 
and recruiting competent tutors with the skills necessary for 
ESL instruction. 
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Instructional Patterns 



The individual projects* instructional patterns can be 
found in Tables 7 and 8. For the scheduled classroom 
projects, these patterns have been defined in terms of the 
planned number of individual classes available, the planned 
number of class meetings per week, the planned number of hours 
per class meeting, the planned number of hours received by 
a student in a week, planned class size, and planned staff/ 
pupil ratios. Since each project may have had different patterns 
for varying classes, the instructional pattern figures repre- 
sent averages for all these classes. For the tutorial projects, 
planned frequency, duration, and hours per student per week are 
provided as averzkges. Given these definitions, data indicate 
the following: 

• Of the student projects using classroom methods, the 
number of separately available classes per project 
ranged from 2 to 2L This broad range indicated the 
variance in project size. The largest project used 21 
separate classes to provide instruction to over 400 
students, while the smallest project used two separate 
classes to provide instruction to approximately 30 
students . 

The frequency of class meetings also varie<^ from only 
one day a week to five days a week. Seven of the projects 
met at least three days a week, while the remaining four 
met only twice a week or less. 

The number of hours per class also varied significantly, 
ranging from normal class periods of 45 minutes to three 
hours per class. Similarly, hours received ranged from a low 
of 1^5 hours per week to a high C>f more than 10 hours per 
week. 

With the exception of only a few projects, class size 
and staff /pupil ratios were fairly similar. Most projects 
had class sizes of 12-16 students, with two projects having 
class sizes over 20 students and one having only 5 students. 
Most projects had one or two teachers per class, resulting 
in staff /pupil ratios ranging from 1:8 to 1:14. Two pro- 
jects had much smaller ratios of 1:4 and 1:5, 

Two student projects used tutorial instruction. One 
project met an average of twice a week while the other 
met m times per week. Hours per session more or 
less the same at one hour and IH hours respectively. This 
resulted in hours received of approximatiy two hours per 
wciek per student tor each project. 
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Of the five adult projects using scheduled classes, the 

?^'4 ?o r^'Vul^f' ^^^^^^^^f -}*-«es per pro^l^t ' ranged 
trom 4 to 8. The frequency of class meetings ranged from 
less than twice to five days a week. Planned hoSs per 
class also vari«i considerably, from five hours per class 
o? tnt ^^^^ disparity result^in a range 

^SV""^ received per week from a low of 2 to a 
high of 15. Class sizes also varied from 5 to 20 students 
per class, and staff/pupil ratios varied from 1:5 to 1:20. 

lLl^knt'L^flZ^^l f^^'^ P^^liects, the frequency of meet- 
™ ? ^^^^^ th^ee times a week. Hours 

per session ranged from IH to 2H resulting in a spectrL 
of hours received per week ranging from 3 to 7H hours 
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Table 5 



Frequency of Major Project Characteristics 

Student Adult 
Projects Projects 



Type of Agency 

Four Year College 
Junior College 
Community Organization 
Library 



Predominant Structure 

Scheduled Classes 
Individual Tutorials 



Location 

Jr. -Sr. High School 

College 

Center 

Homes 

Center & Homes 



10 
1 
2 



11 
2 



5 
4 
4 



1 
2 
7 
1 



5 
6 



5 
1 

5 



School Credit 



Yes 


6 


1 


1 


No 


7 


10 


1 

1 


Staff 






1 

i 

1 


Paid 


13 


7 


t 
i 


Volunteer 




4 




Related Services 






1 

J 


Job Placement 


2 


4 


! 

1 


Health 


4 


5 




Counseling 


9 


11 


i 


Recreation 


5 


4 


t 

1 


Transportation 


7 


6 


( 


Education 


4 


7 


t 
f 


Other 


3 






' None 


1 






1 Recruitment Approach 








Referral 


10 


5 




Required 


2 


1 




General Publicity 


9 


9 




Special Incentives 


4 


1 




Other 


1 


2 





Table 6 

FREQUENCY OF MATERIALS UTILIZATION 



Adult Student 





Projects 




Proj 


ects 




,Used Most, Used 


•Used Mostt Used 


Materials : 


t Often , Somewhat 


, Often 


, Somewhat 


tforkbooks 


• <i 


5 


3 


6 > 


Basal Readers 




1 






Prograunnied Texts 


• 1 




1 




Skill Kits 


1 


1 


3 




High Interest/Low Vocabulary 


1 






/ 6 / 


Cossnercial Games 






1 


1 


Audio-Visual 




3 


1 


3 


Special Techniques 


• 3 


1 




1 


Books ^ Magazines 




2 


1 


3 


Foundational Materials 




4 






Teacher prepared Materials 


. <4 


4 


2 




Other 






1 




Electric 








I 
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Table 7 

SERVICE DELIVERY SYSTEM CHARACTERISTICS-STUDENT PRCWECTS 



SERVICE DELIVERY CHARACTERISTICS 




Predominant Form of Instruction 
iTClass or Tutorial) 


. c ! 


C , 




C , T , C ' 


C , 


c , 


c . 


c , 


T , C , 


C 


Time of Instruction 

{During School day or Out- 
side of School Day) 


• D 


1 ^ 


D ' 


0 ' 0 ' 0 , 


D ' 


0 * 


0 * 


0 • 


• • 
0 ' D ' 


0 


StaiExng (Paxa or volunteer; 


, P 


P , 


P , 


P . P . P ' 


P 1 


P 1 


P » 


P » 


P 1 P » 


P 


School Credit (ves or No) 


* y 


1 Y ' 


Y • 


N * N * N , 


N ' 


Y ' 


N * 


N ' 


N ' Y ' 


Y 


ESL Component (Yes or No) 




' N , 


N , 


Y , N , N ' 


Y . 


N t 


N • 


Y , 


N * N • 


Y 


Number of Centers & Homes 


* 1 


, 1 • 


1 ' 


1 ' : 


> • 5 • 


1 


1 


1 


1 1 


2 2 


1 


INSTRUCTIONAL PATTERNS 
























1 CLASS 
























1 Planned # of classes 


' 3 


21 ' 


4 


' 5 • 


' 6 . 


5 ' 


6 * 


6 ' 


2 t 




15 


Planned Frequency ^ {Meetings 
j per week) 


, 3 


' 2 , 


5 


, 2.2 , 


, 4.7 • 


5 . 


5 . 


2.5 ' 


4 


• 5 • 


1 


Planned Duration (Hours per 
class) 


'.8 




3.2 


' 1.4 ' 


' 2.3 . 


.7 


.8 


1 2 




-9 • 


1.5 


t 

j Planned Hours Per Student 

Per Week (Frequency x Dura-- 
! tion) 


,2.4 


1.8 . 


16 


, 3 , 


•10.6* 


3.5 


' 4.0 


• 5 


' 8 ! 


•4.5 • 


1.5 


. Planned Class Size 


• 16 


, 23 ' 


12 


• 20 • 


! 1^ ' 


14 


! 12 




' 14 • 


. 12 , 


5 


[Planned Staff: Pupil Ratio 

1 


,1:9 


'1:8 . 


1:8 


.1:10 , 


• 1:9 \ 


' 10.4 


•1:12 


•1:4 


• 1:4 , 


'1:1^ 


1:5 


TUTORIALS 
























Planned Frequency 








^ 2 ' 










i-si ! 




! Planned Duration 








. 1 , 










1.3^ 




! Planned Hours per Student 

i Per week 

1 


t » 






• • 2 ' 

• » ■ 










1.9, 
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BEST con . 



Table 8 

SERVICE DELIVERY SYSTEM CmVRACTERISTICS -ADULT PROJECT 



gPRVTrR nRT.TVPRV rHARArTERTRTTrg 




TUTORIALS 



Planned Frequency 


1 2 • 


' 2, 


2 


•1.5 '1.8 


• 3 


Pleuined Duration 


' 2 \ 


.1.5' 


1.5 


,2,2 


, 2.5 


Plamned Hours per Student 
per week 


* 4 • 


* 3. 


3 


• 3 '3.5 


' 7.5 



Predominant Form of Ins true- • 






















tion (Class or Tutorial) • T C , 


T, 




T , 


T , 


T 


. c 


. c 


. c 


1 c 


Staffing (Paid or Volunteer) V • P ' 


V 


V ' 


P ' 


P • 


P 


• P 


' P 


• P 


• p 


School Credit (Yes or No) • N ' N » 


N. 


N , 


N . 


Y , 


N 


. N 


. N 


. N 


. N 


ESL Component (Yes or No) N • Y ' 


N' 


N ' 


N • 


M • 


N 


• Y 


• Y 


' Y 


• N 


Number of Centers & Homes ' 23 [ 3 , 


25! 


16 , 


27 ! 


40 . 


1 


. 1 


. 6 


. 3 


. 8 


INSTRUCTIONAL PATTERNS » 






















CLASS • 






















Planned # of Classes 


4 ' 












• 7 


• 6 


• 6 


• 8 


Planned frequency (meetings 




















per week) 


• 4 • 












• 5 


•1.7 


• 2.5 


• 1 


Planned Duration (Hours per 






















class) 


1 ' 












' 3 


' 5 


•1.8 


• 2 


Planned Hours per Student 






















per week 


♦ 4 












*15 


•8.8 


•4.4 


• 2 


Plfuined Class Size 


• 10 • 












•20 


• 7 


1 5 


• 5 


Planned Staff: Pupil Ratio • 


' 1:10, 












•1:20 


tl:7 


»1:5 


,1:5 
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Classroom and Tutorial 



Activities 
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Direct observations were made of a sample of classes ^nd 
tutoring ssssions and recorded on the on-site observation 
forms. In order to put the findings in proper perspective, a 
full explanation of the items in the on-site instrument is 
necessary first. Basically, the guide facilitated the identi- 
fication of instructional patterns, learning activities, etc., 
in the sessions observed. These items included the following 
major areas s 

• Pattern of instruction — This refers to the basic structure 
identified as either: one-to-one tutoring, multiple one- 
to-one tutoring in a group setting, single group under direc- 
tion of one teacher or tutor, or multiple groups with 
more than one teacher or tutor, 

• Forms of Instruction — The form of instruction identifies 
the overall learning approach used, including the follow- 
ing possibilities: lectures with little or no student 
involvement, teacher -directed instruction with active 
student participation, independent work by studests under 
teacher guidance or observation, and student group process 
with or without teacher involvement. 

• Organizational Style — The classroom or tutorial process 
can be called either structured (ie., highly structured, 
with formal relationships between students and teachers) 
or unstructured (i.e., less structured, with informal 
relationships between students and teachers) • 

• Instructional Activities Sequence — Instructional activities 
can be either: highly structured, with a pre-determined 
sequence of program activities, or less structured, with 

no precisely pre-planned sequence of activities. 

• Content of Instruction — The content of instruction refers 
to specific content areas including: oral ESL, language 
arts feuch as writing, spelling, grammar, vocabulary, 
definitions^ reading development (i.e., specific instruc- 
tion in reading), and school-criented reading (i.e. , instruc- 
tion in reading as it relates to other school subjects) . 
Since developmental reading was deemed to be the most 
important R2R goal, most of the specific data were collected 

. on teaching methods and levels of instruction relative tc 
this approach. Developmental reading methods were classi- 
fied as follows: systematic phonics? applied phonics; 
sight reading (i.e., context clues but no phonics); and 
assisted reading (i.e., no specific method). The various 
levels of instruction were designated as: reading 
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re.'\diness? decoding or vrord recognition; structural 
analysis? and comprehension of materials ranging from 
the meaning of words to advanced study skills. 

Given the above definitional framevrork, findings for 
the student projects are presented first while findings 
for the adult projects are presented second. 

Student Projects 

In general, the student projects r^esented a wide variety 
of approaches to the teaching of reading. There appeared to 
bs little systematic relationship between the type of project 
and the nature of instructional activities. In the 11 class- 
room student projects, single group methods of instruction were 
used more frequently but multiple group methods were also used. 
In almost all cases, instruction was characterized as teacher 
".irected, but m a few instances independent student work was 
the primary form. Organizational style included both structured 
and unstructured approaches, with variations of this nature 
nore often a function of the teacher than of the project. With 
few exceptions, instructional activities were planned in advance. 
Variations in this area also appeared to be a function of the 
individual teacher rather than of the project. In terms of 
content, reading development was emphasized in all projects 
except for one, which emi asized reading directly related to 
the subject matter of existing regular classes. Additionally, 
many of these projects supplemented this activity with language 
arts instruction? oral ESL instruction was also clearly in evi- 
dence at the four projects serving Spanish surnamed students. 
In terms of reading methods, assisted reading approaches were 
most often used, but a few projects also used systematic or 
applied phonics methods. The levels of instruction varied from 
project to project but usually included multiple levels to 
accommodate the wide skill range of their students. Almost all 
projects included some form of basic reading ccxnprehension in- 
struction. 

The two tutorial student projects utilized teacher directed 
instruction. Each of these projects was characterized as 
unstructured in its organizational style. The planning of 
activities included both structured and unstructured approaches, 
depending upon the views of the particular tutor. The content 
of instruction included not only developmental reading but 
language arts at both projects. One project utilized a combina- 
tion of systematic phonics, applied phonics, and assisted reading, 
and the other utilized assisted reading only. As with the class- 
room projects, the levels of reading instruction varied according 
to the students' skill. 
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Adult Projects 



^ As with the student projects, the adult projects also 
utilized a variety of instructional forms and learning approaches. 
All five of the adult projects used single group instruction. 
The form of instruction was primarily teacher directed, with 
two projects also using independent work by students. Organiza- 
tional styles varied and included both structured and unstruc- 
tured approaches. The sequence of activities also included 
both pre-planned and unstructured approaches. The content of 
instruction included botn ESL and developmental reading at each 
of the four projects serving non-English speakers, while only 
developmental reading was emphasized at the fifth project which 
served English speakers. Developmental reading methods also 
varied and included sight reading, assisted reading, and phonic 
approaches. One project used only the ''silent way** method for 
ESL instruction. The levels of reading instruction attempted 
varied greatly depending upon the level of student skills. 



In the six tutorial adult projects, both teacher directed 
and independent student work were used. Organizational styles 
were for the most part unstructured; in most cases the sequence 
of learning activities was pr eplanned. The content of instruc- 
tion at each of these projects included both language arts and 
developmental reading. Methods included a variety of approaches 
with most projects using a combination of assisted reading and 
phonetics. As with all other projects, the levels of instruc- 
tion varied according to individual skills. 

In summary, the following conclusions can be drawn for 
both the student and adult projects: 

• Single group classroom instruction and one-to-one tutoring 
were the two primary patterns of instruction, 

• Teacher/tutor directed instruction and independent student 
work were the two primary forms of instruction . 

• Organizational styles included both structured and unstruc- 
tured approaches, usually depending on the particular instruc- 
tor's style. 

• The sequence ot learning activities included both planned 
and unplanned approaches. 

• Instructional content usually included a combination of 
developmental reading and language arts, with oral ESL instruc- 
tion for non-English speaking students. 

• The methods of reading instruction usually included a combina- 
tion of approaches, with sight reading or assisted reading 
more frequently used than phonetic approaches. 
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• The levels of reading instruction varied fron basic training 
for reading readiness to higher levels of comprehension 
based upon higher levels of student skill. 



Development of Typologies 

v«T-,«I!?T^«^''^ discussion provides evidence of the substantial 
variation in service delivery and instructional oattern raechan- 
isins among both the student and adult projects. >or the most 
part these variations ware more the result of individual project 
decisions than of external factors such as regulations, avail- 
able resources, etc. In analyzing these variations, howevar, 
certain general patterns emerge which are important to consider. 
Ii?^^nr-»L, P^P?^^^ of this study was to identify "saccess- 
ful and unsuccessful^ program and service delivery characteris- 
tics, we attempted to develop meaningful distinctions between 
certain types of projects. This typology development should 
enable us to test variations in project performance. This develcwtient 
proess was carried through by carefuUy identifying important s^rvicT 

wMiHL?o^^c''''^''i^'^''l and then analyzing the data to determine 
Which projects contained similar characteristics. As a result of 
this process, three typologies were developed for the student 

nr^ifSi^^''*^-^!?^^^,^'''' projects. While the typologies 

provide us with only general and typical characteristics (with 
exceptions existing in each group) we believe that such grouping 
provides a valuable means of distinguishing between important 
program variations. We will conclude this chapter, therefore, 
with a presentation of the three student typologies followed bv 
three adult typologies. -^^ ^ jr 

Student Project Type I 

Five student projects have been classified as Type I, on the 
basis of the following characteristics: 

• They all utilized scheduled classes. 

• Instruction vas provided during regular school hours. 

• Paid professional staff provided most of the instruction, 
and many staff members were full-time employees of the 
delegate agency or public school system from which partici- 
pants are recruited. 

• School credit for participation was usually provided, 

• Instruction took place at one or two locations, usually 
the colleges or schools participating in the project. 

• Classes met anywhere from two to five times per week, 
basically for one class period, i.e., 45-50 minutes per 
session. Thus, students received as little as two hours 
of instruction per week and a much as 4% hours. 
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4n«^t^, ?• ? T usually compulsory, based upon the local 
ihfn students to the project 

when their skills are below expectations. 

^r>:.^J^'^T^tl^' ^yP® °^ project vas usually tightly inte- 

grated into the service structure of the delegate agency, and 
aroundlraS^l^n'f ?^ organizational patterni which revolved 
?o S2f^ ? classroom strategies, in effect, these Right 

to Read classes were very similar to regular class of f erinas 
except that they served a group of students requiring remedial 

Student Project Type II 

rn,-, student projects have been classified as Type II 

t^iio ^J?:^^^^ 'TyP^ ^ projects as scheduled classrSSm opera- 
tions, they are not as fully integrated into regular school 
processes. Specifically, they hal the following characteristics 

• They all utilized scheduled classes. 

• Instruction was provided after regular school hours. 

• Paid staff provided instruction. Instructors were either 
professionals, paid tutors, or work/study stuaents. 

• School credit for participation was usually not provided. 

• Instruction usually took place at one or two centers, 
usually the delegate agency site(s). 

• ^""^^ ^ ^ meetings per week, and anywhere 
from 1 to 5 hours per meeting. Thus, students receive 
from m to 16 hours of instruction per week. 

• Participation in the project was usually voluntary. 

In summary, this typology is similar to Type I inasmuch as 
instruction i«£ provided by paid staff in classroom settings, 
but significantly different inasmuch as classes met after school 
hours and participation's voluntary. This typology thus repre- 
sents additional services provided to participants; not replace- 
ments for regular school operations as in Type I. 

Student Project Type III 

^. Two student projects have been classified as Type III. 

q«f^^??);f??*^^fK^''^*5^^?u^y.^^^'^^ one-to-one tutorial stricture. 
Specifically, they had the following characteristics: 



51 



• They utilized one-to-one tutorial instruction, 

• Instruction was provided after school hours, 

• Paid tutors provided instruction. Tutors ware either pro- 
fessionals, work/study students, or college studentsT 

• School credit for parti cipation was not provided. 

• Instruction took piacf^ at one or two centers. 

• Sessions took place less often than in Types I and II, 

usually twice a week for 1 to 1*$ hours per session. 

Thus, students received approximatly two hours of instruction 
per week. 

• Participation in the project was voluntary . 

In summary, this typology is similar to Type II inasmuch as 
instruction vas provided after school and participation was volun- 
tary. It is differentiated by the fact that instruction was one- 
to-one tutoring and students receive substantially less hours of 
instruction per week. 

Adult Project Type I 

Five adult projects have been classified as Type I. They 
ha the followinig characteristics: 

• They all utilized scheduled classes. 

• Paid professional staff provided the instruction. 

• School credit ««£ not provided. 

• For the most part, instruction focused on learning to speak 
English, i.e., ESL as well as reading instruction. This vas 
necessitated by the fact that these projects primarily 
served non-native English speaking populations. 

• Instruction took place at a few local centers. 

• Classes met anywhere from 1 to 5 times a week, from 1 to 5 
hours per class. Thus, students received anywhere trom 5 

to 20 hours of instruction per week. 

• Participation in the project wis voluntary. 

In summary, this typology vas similar to Type II of the stu- 
dent projects, except that instruction focused on ESL as well 
as reading. 
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Adult Project Type II 

Three adult projects have been classified as Type II. These 
projects had the following characteristics: 

• They all utilized oiie- to-one tutorial instruction. 

• Paid tutors were used to provide instruction. 

• School credit was not provided. 

• Instruction focused exclusively on reading, not on oral 
English. 

• Instruction took place at numerous centers including tutor 
and tutee homes. 

• Sessions met from 1% to 3 times per week, f.or 2 to 2*5 hours. 
Thus, students received from 3 to 7% hours of instruction per 
week. 

• Participation in the project was voluntary. 

In summary, these projects can be characterized as one-to- 
one tutorial projects with instruction provided by paid tutors, 

Adult Project Type III 

Three projects were classified as Type III. These projects 
ha the following characteristics; 

• They all utilized one-to-one tutorial instruction. 

• Volunteer tutors were used to provide instruction. 

• School credit *as not provided. 

• Instruction focused exclusively on reading, not on oral 
English. 

• Instruction took place at numerous centers including tutor 
and tutee hoems. 

• Sessions met two times a week for i^ to 2 hours. Thus, 
students received from 3 to 4 hours of instruction per week* 

• Participation in the project was voluntary. 

In summary, these projects are similar to adult Type II, 
except that tutoring v&.s provided by volunteers rather than paid 
staff. 
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CHAPTER V 

i 

ENROLLMENT & AHENDANCE PATTERNS 



Bas^d%^^;j^iS\''^^^^""^"^'?^ overall impact of the Conununity- 

Based Program xs the pro3ects' ability to serve a sufficient num- 

ho»ro ^"f.*"'' ^''^"''^ participants receive sufficient 

hours or instruction to generate significant reading improvement. 

^^f^^^fy interpret enrollment and altendancrpat^ 
uerns, information was collected and a series of assessment mea^ 
sures were developed. These measures will be discussed in this 
chapter tor descriptive purposes and will be used to analyze test 
results m Chapter X. Specifically, the tollowing project mea- 
sures were utilized: ^ f^^j^^^ mca 

• Cumulative Enrollment— This is defined as the total number 
?i ^ff^i^^^^"^^ ^ project from December 1, 1973, to May 
Ji, 1974. (A student was considered a peurticipant if we 

• Continuees, Completers, and Terminees— The cumulative enroll- 
ments were categorized as continuees (i.e., anyone who was 
still participating as of May 31, 1974) r completers (i.e., 
anyone who successfully completed the project); and terminees 
(I.e., anyone who withdrew or was dropped from the project) 
For purposes of analysis, continuees and completers have 
been COTibmed since their participation can be considered a 
positive outcome while termination of participation must 

De considered a negative outcome. 

• Monthly Attendance and Average Monthly Attendance — Monthly 
attendance is defined as the number of students who actually 
attend at least one class or tutorial each month under 
consideration. Average monthly attendance is the mean of 
the monthly attendance figures for December *73 throuah 

May *74. 
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• Average Weeks of Enrollment—This is defined as the number 
of weeks of participation starting from the date of enroll'- 
ment and ending either May 31, 1974 or on the termination 
or completion date, whichever is sooner. 

• Estimated Potential Hours of Instruction — This is defined 
as the average nunber of weeks of enrollment per student multiplied by 

the planned number of instructional hours per student per 
week. Thus, this figure represents the total average 
potential hours received and is an overestimate of actual 
hours since most students do not attend 100% of their 
sessions . 

Given these definitions. Tables 9 through 11 present the 
findings for the student projects (which will be discussed first) 
and Tables 12 through 14 present the findings for the adult 
projects (which will be discussed second) . 



Student Projects 

Cumulative Enrollment 

The average cumulative enrollment for all 13 projects was 
130 students, as indicated in Table 9. Extremely wide variations 
have been found to exist, with one project serving as many as 
53 i> students and another serving only 32 students. (It should 
be noted that the largest project operates on a quarter basis, 
thus serving two groups of students during the six month evalua- 
tion period.) 

These variations were assessed in relation to a number of 
programmatic factors in our attempt to identify causes for the 
distribution. The major factors considered were dollar resources 
and institutional support, service delivery strategies, project 
goals and orientations, and recruitment and selection approaches. 
Contrary to expectations, these variations cannot be substantially 
accounted tor by available dollar resources, although the deploy- 
ment of these resources does account for some variations. (This 
will be more fully discussed in a later chs^Jter .) , Variations are 
also not accounted for in terms of service delivery strategies. 
Contrary to expectations, projects that have larger than average 
class sizes and staff to pupil ratios do not necessarily serve 
more students than projects with snail diss size or tutorial prograns. 

Variations can be accounted for largely in terms of project 
policy and recruitment efforts. Projects seem to have basic 
goals on how many people to serve and then meet these goals 
(exclusive of resource constraints.) Moreover, recruitment 
strategies and the degree of mandatory participation determine 
how many students will actually enroll, since the projects 
tend to serve anyone who enrolls with no upper limits, Also^ 
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delegate agency seems to have some bearing on 
the differences, with large projects usually closely aligned to 
the regular services of the delegate agency. 

Average Monthly Attendance 

The average monthly attendance for all 13 projects was 65 
students, as indicated in Table 9. These monthlv attendance 
figures are substantially below the figures for" cumulative enroll- 
ment for 4 primary reasons: 

First, most projects experienced a high rate of termination ; 
second, many students who did not completely terminate were never- 
theless absent for as much as a full month; third, many students 
joined the projects after the evaluation had already begun, thus 
inflating the cumulative totals? c-nd fourth, some projects had 
semester breaks or were not in operation for several months, 
thus having no enrollment during these months. (The impact 'of 
termination is extremely significant and will be fully discussed 
in chapter X , ) 

In summary, almost all projects experienced declining atten- 
dance because terminations occurred at a faster rate than new 
enrollments. Attrition was thus a major factor in the determina- 
tion of average monthly attendance. 

Average Weeks of Enrollment 

Table 10 shows the average weeks of enrollment for the 
cumulative population, for continuees/completers , and for terminees 
As indicated earlier, these figures were computed by totalling the 
number of weeks between enrollment and May 31, which is an arbi- 
trary cut-off date based on evaluation and not program require- 
ments. Thus, the enrollment figure for the total population and 
contmuee/completers are deflated since enrollment for these 
students may in fact continue through the summer and the follow- 
ing program year. 

Wtth this limitation in mind, we can say that the average 
weeks of enrollment for all projects was 23 weeks. As expected, 
the average weeks of enrollment for continuee/completers is 
higher than for terminees (26 to 17 weeks) . Two projects have 
substantially higher average enrollment figures (46 and 31 weeks), 
indicating that they are especially capable of holding their 
students for more than one program year. Interestingly, the 
project with the 46 week average serves the fewest number of 
students, suggesting that their concentration is on stability 
instead of a large service effort. 

Program structure and late start-up dates account for the 

relatively low figure for average weeks of enrollment. Three 

of the projects, with averages of 20 or below, did not start 

their programs until January or later and two projects (with 
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averages of 14 and 17) operate on a quarter basis with many 
students only attending one or two quarters. 

Hours of Instruction Received 

Table 11 presents the estimated hours of instruction received 
for the cumulative population, continuees/completers, and terminees. 
The overall project average is 128 hours for all students? 149 
hours for continuees/completers; and 103 hours for terminees, (As 
indicated earlier, this is an estimate of potential hours which 
is inflated due to absenteeism. Actual hours of instruction and^ 
their relationship to performance are discussed in Chapter X ) . 
On a project basis the variations are substantial: In three pro- 
jects students potentially receive over 300 hours of instruction, 
while students in the other 10 projects receive less than 100 
hours of instruction. Thus, in most projects, students receive 
less than 100 hours of instruction in a six month period — a point 
which is important to note, since prior research has suggested 
that a minimum of 100 hours of instruction is needed to generate 
substantially improved performance. Clearly, the variations 
among projects is due directly to varying lengths of enrollment 
and service delivery patterns with weekly hours of instruction 
ranging from IH to 16 hours. 



Adult Projects 

Cumulative Efirollment 

The average cumulative enrollment for all 11 adult projects 
was 109, as indicated in Table 12. As in the student projects, 
wide variations existed, with one project serving over 200 students 
and another serving only 55 students. Systematic reasons for 
variations cannot be found in terms of resource availability or 
strategies of service delivery, although a combination of these 
and other factors must be responsible. For example: while the 
project serving the most students utilizes a classroom approach 
and actually does have the highest cash budget, the second 
largest project utilizes one-to-one tutorials and has only an 
average cash budget. Our data suggest, in other words, that 
enrollment sizes tor adults as well as students tend to be more 
a function of project goals and recruiting effectiveness than a 
result of budgetary constraints or service delivery strategies. 

Average Monthly Attendance 

The average monthly attendance for all 11 projects is 51 
students, as indicated in Table 12 , The reasons these figures 
are substantially below cumulative totals are comparable to 
those mentioned for the student projects. For the most part, 
adult projects experienced declining attendance levels over 
the six month evaluation period as a result of attrition. 
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Average Weeks of Enrollment 



Average weeks of enrollment for the cumulative population, 
for continuees/completers, and for terminees, are presented in 
Table 13. The average weeks of enrollment for all projects was 
36 weeks. The average for continuees/completers was 40 weeks 
while the average for terroinees was 23 weeks. The difference 
between terminees and continuees/completers is more substantial 
in these projects chan in the student projects (a difference of 
17 weeks) , indicating that adults who do not terminate continue 
in the program for extended periods of time. They stay substan- 
tailly longer than student project participants, suggesting that 
their committment is more enduring; or that they require longer 
periods of ins' ruction to accomplish their literacy goals; or 
that «?t«f!ent projects are not set up to serve for an extended 
time. 

Hours of Instruction Received 

Table 14 presents the estimated hours of instruction received 
by the cxMnulative population, by continuees/completers, and by 
terminees. The overall project average is 184 hours for all stu- 
dents, 202 hours for continuees/completers, and 102 hours for 
terminees. On a project basis the variations are substantial: 
3 projects provided over 300 hours of instruction, 4 projects 
provided between 100 and 160 hours of instruction, and 4 projects 
provided less than 100 hours of instruction. As with the student 
projects, these variations among projects can be traced to vary- 
ing service delivery patterns, with hours of weekly instruction 
ranging from 15 to 2 hours. 

In summary, the tollowing conclusions can be drawn for both 
student and adult projects: 

• Cumulative enrollments vary substantially among projects; 
these variations are due more to project goals and recruit- 
ment efforts than to resource constraints. 

• Average monthly attendance is substantially less than cumula- 
tive enrollments due primarily to attrition and absenteeism. 

• Average weeks of enrollment also vary among projects, with 
adults generally attending longer th«m students, and continuees 
and completers attending longer than terminees. 

• Potential hours of instruction received also varies substan- 
tially among projects, with some projects delivering much 
more than 100 hours of instruction but more projects deliver- 
ing less than 100 hours in the six month evaluation period. 
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CHAPTER VI 

BUDGET & COST/SERVICE PAHERNS 



The purpose of this section is to diiscuss the financial 
resources of the projects and then compare these resources to 
the services delivered in order to identify varying rates of 
efficiency. As in the previous two chapters, these data are 
presented for purposes of descriptive assessment only? the 
full relationships between cost and outcome will be discussed 
in Chapter 10. A series of budget/resotxrce measiires and 
service measures were used to make these comparisons. These 
included the following: 

• R2R Budget, Other Cash & Total Budget — The R2R budget is 
the FY 74 grant? other cash represents dollar resources 
obtained from non-federal sources; the total budget is the 
simi of these two figures. 

• In-Kind Contributions — In-Kind Contributions represent 
non-cash resources provided primarily by tke delegate 
agency. Whxle in mamy cases these resources comprise 
substantial and important parts of real operating costs, 
it proved to be beyond the scope of this study to obtain 
comparable dollar equivalents for all the projects since 
each project uses different accounting principles to 
assign dollar values. Accordingly, in-kind contributions 
have been placed in two categories — above $10,000 received 
and below $10,000 received. Because of the nature of this 
information, it is not included in total budget amounts. 
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Cost Per Student — These measures encompass two approaches. 
The first compares six month budgets to cumulative enroll- 
ment while the second compares one month budgets to average 
monthly attendance. Monthly budgets were established by 
dividing the total budget by the number of months of opera- 
tion. These two measures thus estimate (\) the average cost 
of serving each student enrolled for six months, and (2) 
the average cost of serving each attending student for one 
month. 

Cost Per Hour of Instruction — In order to account for both 
student and instructional hours, the cost per instructional 
hour was computed. This measure compares the monthly bud- 
get to the potential hours of instruction delivered. The 
latter figure is defined as planned hours of weekly instruc- 
tion per student times 4.3 weeks times average monthly 
attendance. 

These figures are estimates and must be viewed in terms 
of the following considerations. First, that only budget 
data and not actual expenses have been used, on the reason- 
able assumption that projects spend their full resources. 
Second, that monthly budget estimates do not take into 
account varying levels of monthly expenditures, since it 
is reasonable to assume that monthly rates of expenditure 
are similar. Third, that an average cost per student does 
not fully reflect the actual differential costs of serving 
a continuing student by <.ontrast to a student who attends 
infrequently or terminates early. (Cumulative enrollment 
measures are included, however, since there is a real cost 
Involved in serving anyone who enrolls, even if full 
instruction is not provided.? Fourth, that cost per stu- 
dent data is not a complete measure of efficiency since 
hours of instruction delivered is not taken into account 
Ce.g., projects could have the same cost per student, yet 
different levels of instruction received) . 

Given these definitions. Tables 15 through 17 present 
the data for the student projects discussed first, and 
Tables 18 through 20 present the data for the adult pro- 
jects, discussed second. 
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student Projects 



Budget Comparison 

The average R2R grant for the 13 student projects is 
$45,220, with limited variations ranging from $30,000 to 
$63,820. Only one project received additional cash contribu- 
tions, resulting in an average total budget of $45,336. The 
average project utilizes 74% of its budget for personnel costs, 
leaving 26% for materials, supplies, travel, rent, etc. Sub- 
stantial variations in this kind of resource allocation do 
exist, with one project using 90% of its dollars for personnel 
and another using only 45%. 

Most of the projects received a substantial amount of 
in-kind contributions, with eight projects receiving over 
$10,000 and five receiving less than $10,000. in-kind contri- 
butions primarily cover costs such as parts of staff salaries, 
rent, materials, and equipment. In most projects, these 
institutional contributions are an integral part of project 
resources, and without them the R2R grant would have limited 
leverage and impact in terms of the level of service available. 

Cost Per Student 

The average cost per student for a six month period is J309, 
with substantial variations ranging from $42 to $654. On a 
month! V basis, the average cost per student is $90, with a low of 
$22 and a high of $163. As indicated, earlier, cost per student 
figures should be expected to vary substantially since the 
varying amounts of instruction from project to project have not 
been taken into account. {it should also be noted that the 
monthly cost per student is not l/6th of the six month cost, 
since monthly attendance figures are lower than actual enroll- 
ment due to absenteeism and attrition.) 

Cost Per Hour 

The average cost per hour is $5.80, with substantial varia- 
tions ranging from $1.37 to $14.66. TKus, when the numbers of 
students and hours delivered are taken into account, projects 
demonstrate a wide range of efficiency defined in these terms. 
Moreover, while it was beyond the scope of this study to fully 
analyze varying efficiency rates (particularly in their relation- 
ship to differential salary rates) , some general conclusions can 
nevertheless be made. First, as suggested earlier, different 
service delivery strategies do not account for different effic- 
iency rates, i.e., projects with larger staff/pupil ratios are 
not necessarily less expensive than those with smaller ratios. 
Efficiency seems to be more closely related to the deployment 
of personnel. Specifically projects which maximize the 
actual teaching time of their full-time or part-time staff are 
capable of delivering more instructional hours per dollar, thus 
resulting in more efficient operations defined in these limited 
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terms. One should not conclude, however, that a more efficient 
project is necessarily a more effective project, since only 
performance is a true measure of outcome, not the quantity of 
services delivered. 



Adult Projects 

Budget C<yiiparisons 

The average R2R grant for the 11 adult projects is $48,509, 
with substantial variations ranging from $28,000 to $99,764. 
Four projects received additional cash contributions, with one 
receiving $67,000. Thus, taking this into account, we find that 
the average total budget for the 11 projects is $56,655. 

The average project uses 72* of its budget for personnel, 
with limited variations ranging from 57% to 88%. Four projects 
received more than $10,000 of in-kind contributions while seven 
received less than $10,000 of such contributions. For tne most 
part, the amount of in-kind contributions varies according to 
the type of delegate agency, with universities and public insti- 
tutions providing more m-kind resources than community organiza- 
tions. This should not be surprising since communtiy organiza- 
tions with limited tunds must rely on R2R and other grants to 
cover expenses and are less capable of utilizing federal monies as 
a leverage to obtain free services. 

Cost Per Student 

The average cost per student for a six month period is $J03 , 
with variations ranging from $191 to $543 . On a monthly basis, 
the average cost per student is $114, with a high of $277 and 
a low of $64. 

Cost Per Hour 

The average cost per hour is ?6.82 , witn substantial 
variations ranging from $1.31 to $16.11. It is important to 
note that volunteer tutoring projects (as may be expected) do 
not aecessarily cost less than projects staffed by paid instruc- 
tors. For exaunple: the most efficient project was found to 
use a paid staff and a classroom strategy, while one of the 
tutorial projects staffed by volunteers was found to have a low(=?r 
them average efficiency ratio. As with the student projects, 
the efficiency of the projects is thus more a function of the 
deployment of resources than of a particular service delivery 
strategy. 
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In sunimary, the following conclusions can be drawn for 
both student and adult projects: 



• The average R2R grant for both the student and adult pro- 
jects is approximately $47,000. Student projects rarely 
receive additional non-federal monies, but generally receive 
substantial in-kind contributions. Adult projects are 
most likely to receive non-federal monies, but generally 
receive less in-kind contributions. Community organizations, 
operating student or adult projects, do not receive as many 
in-kind contributions as college and university operated 
projects. 

• Both student and adult projects spend approximately 73% 

of their monies for personnel, although substantial varia- 
tions do exist, particularly among student projects. 

• Cost per student and cost per hour of instruction vary 
substantially among both student and adult prpjects, with 
student projects generally costing less than adult projects » 
cn a cost par hour basie. These variations in efficiency are 
hard to account for in systematic terms, but generally seem 
to relate to tne deployment of staff time and not to varying 
service aelivery strategies. 
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CHAPTER Vn 

TARGET POPULATION CHARACTERISTICS 



In this chapter we will present descriptive findings on 
th^ demographic and personal characteristics of project parfi- 
cipants. This data, which was collected from the student da'ca 
forms, includes information on sex, ethnicity, age, grade status, 
native language, English language skill (for those participants 
whose native language is not English), and the reasons for 
enrolling in the program. 

Information about the student projects is discussed first 
and is presented in Tables 21-26? information about the adult 
projects is discussed second and is presented in Tables 27-33. 

These tables are organised in a frequency distribution 
format giving 1) percentages tor each characteristic by individual 
project, a*id 2) ovarall means for the projects, i.e., means of 
pr'-jject percenta»;es and overall means for the participant popu- 
lation, i.e., weighted meaois. 

Our discussion will be limited to individual project per- 
centages and overall percentage means for the participant popula- 
tion, sinc€i these are considered representative of the total 
Right to Read community-based population. 



Student Projects 

Sex Distribution 

In total, the profile served i . >latively equivalent per- 
cent of males (52.5%) and females (47./^). Variations did exist 
somewhat on an incAvidual project basis, to the extent that four 



projects served a higher proportion of males (ranging from 55% 
to 75%) while three projects served a higher percentage of females 
(ranging from 58% to 62%). There appear to be no systematic 
reasons for these variations, which were usually due to unique 
characteristics of individual projects (such as recruitment 
sources — like a Catholic high school— which may have only males 
or femalasror a special incentive — like a boys* basketball 
team — which is more appealing to one sex than another) . 



Ethnic Distribution 

Blacks aocxxmted for 64% of the total sample population, fol- 
lowed by whites (18%), Spanish surnamed (15%), and others such 
as American Indians, Asians, and so on (3%). Six projects pri- 
marily served blacks, with five of them serving blacks almost 
exclusively; three projects primarily served whites? and four 
projects primarily served Spanish surnamed people. Thus, almost 
every project concentrated on serving only one particular ethnic 
population, reflecting the nature of either the institution or 
the community being served. 

Age Distribution 

Twelve percent of the student population vas under age 14, 
33% were between 14 and 16, 32% were between 17 and 20, 19% were 
between 21 and 33, and 4% were older than 33. Three projects 
served a majority of students less than 14 years old; five pro- 
jects served a majority of students between 14 and 16 years old; 
and the remaining projects served students with a broader age 
range. 

Grade Completion status 

The ages of the student participemts in all of the projects 
were primarily a function of the grade levels the projects were 
designed to serve. For the most part, projects concentrate on 
serving an exclusive group of either college, high school, 
junior high, or elementary school students. In total 1.7% of 
the students we!?e below third grade, 7.3% ware between third and 
sixth grades, 28.7% were between seventh and eighth grades, 
18.4% were between ninth and twelfth grades, and 43.9% were above 
twelfth (i.e., in college). On an individual project basis, 
four projects served primarily college students — usually freshmen; 
three projects served primarily high school students; five projects 
serve primarily junior high students; and one project served a 
broad range of elanentary through junior high students. 

Native Language 

Native English speakers accounted for 87% of the total popu- 
lation, followed by native Spanish speakers accounting for 12%, 
a;id all other languages accounting for 1%. On an individual 
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project basis, 10 projects served primarily native English 
speakers, and three projects served primarily native Spanish 
speakers. 

English Language Skills of Non-Native English Speakers — 
In order to identify the English skills of non-native English 
speakers at the time of enrollment, two questions were asked 
to determine students* fluency in spoken English and their 
ability to read their native language. In terms of English 
fluency, 83% of this group said they were fluent in spoken 
English and 17% said they were not. 81% of this group said 
they could read their native language and 19% said they could 
not. These findings suggest that the non-native English 
speakers had relatively advanced skills, and even though their 
initial language was not English, most of them had command of 
spoken English and the capability to read their own languages, 
thus suggesting that the transferability of these skills would 
make it easier for them to learn to read English them for those 
not fluent in English and not literate in their own language. 

Reasons for Enrollment 

Students were asked to check one or more reasons explaining 
their enrollment in the project. These reasons included: 
"Counselor (teacher, parents, peurole officer, etc.) said that i 
should enroll"; "Want to learn to read (or read better)." 
(Under the second reason a series of sub-items were identified, 
including "do better in school," "handle life situations better," 
"get a job," or "other.") Multiple responses were allowed, 
resulting in the following: 34% of the students answered 
"counselor suggested" as a reason, 72% answered "want to learn 
to read";. 45% answered "do better in school", 22% answered 
"handle life situations better," 20% answered "get a job," and 
7% gave other reasons. These findings suggest the following: 

In general, more students perceived their participation as 
voluntary than as the result of an external decision made by 
some third party, as indicated by the fact that more than twice 
as many students checked "I want to learn to read" than "coun- 
selor suggested." On an individual project: basis, however, 
five projects had more than a majority of their studen*:^ answer- 
ing "counselor suggested", clearly indicating that these projects 
had either mandatory participation requirements or strong 
external influences on the students' decision to participate. 
Or* the other hand, even in these five projects, a majority of 
the students also checked "I want to learn to read?, indicating 
that even if participation was mandatory, they recognized the 
need to learn to read as th^r primary goal. 

Secondly, of those students who checked any of the sub- 
items, "do better in school" was answered twice as often as 
any other it&a, indicating that the students perceived improved 
reading capability as a direct and necessary means to accomplish 
school related objectives. 



78 



AduU Prelects 



In total, the projects had substantially more women (58%) 
than ipen (42%). On an individual project basis, seven projects 
served more women than men and three projects served more aen 
than women. While we have no definitive data indicating why 
this distribution existed, several theories can be suggested: 
First, adult women generally have more free time than men since 
women participate less often in the labor market. Second, 
women are currently being encouraged to upgrade their skills in 
an effort to equalize their position in society. Third, women 
may have less resistance than men to admitting that they are illit- 
erate or functionally illiterate. Fourth, as women move into 
3obs and acquire more work responsibility, the necessity to 
read becomes more apparent and important. 

Ethnic Distribution 



Spanish «urnamed adults accounted for 47% of the total sample 
population, followed by whites (21%), blacks (21%), and American 
I^d^l^ns, Asians, and other minorities (11%). Five projects 
served a majority of Spanish adults? three projects served a majority 
oLwt®^' ^^hH projects served a majority of blacks, and one. 
project served Indians exclusively. Thus as wi*-h the I T\ 

projects, most adult projects c^tra?^^''orse^^L onr^part^ 
cular ethnic group reflectina la-ifVo,- « l one parti- 

or the ethnic'maklup Of fhe lo^S^Uy!"^ °' institution 

Age Distribution 

^42% of the adult population v»» 34 years of age or older, 35% 
were between 21 and 34, 17% were between 17 and 21, and 6% were under 
17 . It is important to note that a high percentage of the par- 
ticipants fell in the above 34 category, since traditionally 
educational and social service programs have found it difficult 
to attract older clients. Moreover, from the participants' 
standpoint, it suggests that they were not fatalistic and still 
believed that they could overcome their handicaps even if they 
had not been in an educational setting for many years. 

Grade Completion Status 

tT ^ adults had completed less than three years of 

U.S. schooling; 13% had completed between third and sixth 
grades? 12% had completed between seventh and eighth grades? 
20% had completed between ninth and eleventh grades? and 6% 
had completed high school. Thus, most adults had not attended 
U.S. schools for a significant length of time. Those who had 
less than three years were the Spanish surnamed adults who 
had cone to tBe U.S. after their youth. The other groups 
r^esented primarily biiick and white adults who attended U.S. 



schools through junior high, but remained either functionally 
illiterate or oompletely illiterate. In effect, then, the 
adult projects were serving two distinct groups with separate 
problems, the first being those who had no U.S. schooling and 
for the most part could not road nor speak English and the second 
being native Americans who had attenlad at least sane U.S. sdtooliia 
but failed to learn to read. 

Native Language 

The above conclusions are supported by the distribution 
of the students* native language. Spanish account^ for 45%, 
English for 43%, and American Indian, Chinese, and other languages 
for 12%. On an individual project basis, over 60% of the 
population were native Spanish speakers in throe projects, and 
60% of the population were native English speakers in four projects. 
The remaining three served a closer distribution of English cind 
Spanish speakers. 

English Language Skills of Non-Native English Speakers — 

Of the non-native English speakers, only 18% were fluent in 
spoken English and 82% were not. 80% were literate in their 
own language and 20% were not. This was an extremely important 
finding in terms of the goals and nature of the adult projects. 
In effect, those projects serving non-native English speakers 
were dealing more with an oral language problem than witli a 
reading or literacy problem since thetr participants are liter- 
ate in their own tongue but had not yet learned the English 
language. Thus, as indicated in Chapter 4, these projects 
must conoentrate on oral ESL instruction prior to or simultaneous 
with reading instruction. Moreover, it may be hypothesised 
that once the English speaking barrier is removed, leeirning 
to read English may be an easier task, since literacy can be 
transferred instead of being learned for the first time. 

Reasons for Enrollment 

88% of the adults checked "want to learn to read" as their 
primary reason for enrolling while 14% checked •'counsellor 
suggested enrollment." Thus, an overwhelming majority of adults 
s thett participation as voluntary and not the result of 
external influence or pressure. Being able to read was seen as 
a vehicle for "handling life situations better" by 49% of the 
adults; for "getting a job" by 42% of the adults; and for "doing 
better in school" by 20% of the adults. Thus, as expected, 
most adults perceived reading improvement as a means of obtaining 
specific functional goals vis a vis educational goals. 
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Employment Status 



Finally, the employment status of the adults was identified, 
which was not computed for the student projects since most of 
th^ are full-time students and employability is not a relevant 
issue during their school years. 45% of the adults v/ere unemployed; 
8% worked under 20 hours a week; and 47% worked over 20 hours 
a week. Thus, an extremely large percentage of the adults were 
unen^loyed, indicating the major difficulties illiterates have 
in participating in the labor markets. On a project basis, five 
projects had over 50% of their participants in the unemployed 
category. While we do not have complete data on the reasons 
for unemployment, the following hypotheses are suggested: First, 
many of the women in the projects may not have been actively 
seeking jobs; second and more relevantly, many men and women 
who were actually seeking jobs cannot find them because they could 
neither read and/or speak English. Thus, illiteracy clearly 
proves to be a major barrier to economic self-sufficiency. 

In summary, the following key conclusions can be made 
regarding the demographic and personal characteristics of both 
the student project and adult project participants: 

• The student projects served an equivalent number of males 
and females, while the adult projects served more females. 
Thus, adult men were more difficult to recruit into a 
voluntary literacy program such as R2R than vere woraen. 

• Blacks vrere the primary ethnic group served by the student 
projects, followed by whites and Spanish surnamed individuals, 
while Spanish surnamed people viere the primary ethnic group 
served by the adult projects, followed by an equal number 

of blacks and whites. Thus, the Right to Read program 
vas concentrating on serving ethnic minorities who were 
either not learning to read in the school system, or who 
were non-native Americans having limited or non-existent 
English speaking skills. 

• Student projects primarily served people between 14 and 21 
years of age who were in junior high, senior high, or college, 
while adult projects are primarily serving people 21 years 
and older with a substantial percentage over 34 years, 

who either had no U.S. schooling or who had completed junior 
high. 

• Student projects primarily served native English speakers, 
while adult projects served an equal number of native Eng- 
lish speakers and native Spanish speakers. The native 
Spanish speakers in the student projects weare generally 
fluent in spoken English and literate in Spanish? the 
native Spanish speakers in the adult projects weregonerally 
not fluent in spoken English but were literal te in Spanish. 
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Thus, adult proiects must concentrate en oral EST. as vjell as readim — 
while the student projects can concentrate completely on' 
reading. 

Both the students and adults perceived their participation 
as voluntary. The students primarily saw reading as a 
means for achieving school related goals, while adults 
primarily saw reading as a means for achieving functional 
goals such as getting a job or improving one's life 
situation. 

Finally, almost 50% of the adults were unemployed, suggesting 
that illiteracy is a major barrier to entering the labor 
force. 
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CHAPTER VIII 

STAFF CHARACTERISTICS 



This chapter presents descriptive findings on the relevant 
demographic and personal characteristics of staff members. 
These data were collected from the staff data forms and include 
information on sex, ethnicity, age, native language, language 
fluency, and educational and teaching experience. Additionally, 
cumulative staff sizes, termination rates for staff, and reasons 
for termination are presented, and the results of the staff 
questionnaires are also discussed. 

The staff characteristics of the student projects are 
discussed first and presented in Tables 34 through 38. The 
staff characteristics of the adult projects are discussed second 
and presented in Tables 39 through 43. These tables utilize 
both frequency distributions and means (whichever is most appro- 
priate) to present these data. These data are provided for each pro- 
ject individually and totals include both project means and 
population means. VThen both overall project means and popula- 
tion means are computed, only population means will be discussed. 



Student Projects 

Sex Distribution 

In total, females aocounted for 68% of the staft while males 
accounted tor 32%. On an individual project basis, only three 
projects had a majority of males and two had equal numbers of 
males and females. Thus, the staff of these projects reflected 
the typical predominance of female teachers in elementary and 
secondary schools. 



Ethnic Distribution 



Whites accounted for 66% of the staff, followed by blacks (17%), 
Spanish surnamed (15%), and all others (2%). Five projects had 
a majority of black staff members- '>ur projects have a majority of 
white staff members, three projec had a majority of Spanish 
surnamed staff members, and one pro3ect had relatively equal num- 
bers of black, white, and Spanish surnamed staff members. Relative 
to the characteristics of the student population, there were pro- 
portionately more white staff members than white students. In 
most cases, however, on a project Ijasis the ethnic predominance of 
students and staff was usually the same. Thus, the disproportion- 
ately high number of white staff members resulted from the fact 
that the two projects with the largest staff were primarily com- 
posed of whites. 

Age Distribution 

Th9 average age of all staff members vas28. On a project 
basis r there vas relatively limited variation, with a high mean 
age of 38 and a low mean age of 24. 

Native Languages 

Native English speakers accounted for 85% of the staff, 
followed by Spanish speakers accounting for 14%. The distribu- 
tion of the staffs' native language was equivalent to the students' 
distribution, which was 87% English and 12% Spanish. On a project 
basis, three of the four projects serving primarily Spanish 
surnamed students had a majority of staff whose native language 
was Spanish, 

Language Fluency 

Besides English, Spanish was the only other language in 
which staff members were fluent. Specifically, 22% of the staff 
were fluent in Spanish, which vas consistent witii the language 
fluency distribution of the students. 

Educational and Teaching Experience 

On an average, staff members of the student projects had 
attended approximately 16 years of schooling. On a project 
basis, the variation was limited, ranging from a high of 18 to 
a low of 14. Thus, staff members had generally attended four 
years of college. 

The average number of years of teaching experience for all 
staff was 3.3 years. On a project basis, the variation ranged 
from a high of 8 ye^irs to a low of 1.2 years. 22% of the staff 
had teaching creder;:tials, with variations on a project basis 
ranging frcm a high of 60% to none. 50% of the staff had taken 
at least one formal course in reading instruction, with varia- 
tions on a project bitsis ranging from a high of 100% to none. 
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Thus, in general, the student projects' staff members had had 
extensive educational training and, at least, a minimal amount 
of teaching experience and instruction in teaching reading. 



Adul t Projects 

Sex Distribution 

As with the student projects, females accounted for a much 
higher proportion of the staff (75%) than males (25%). On a 
project basis, only one project had more males than females 
and in fact had an all male staff (which may be due to the 
cultural context of this project, which served American Indians). 

Ethnic Distribution 

Whites accounted for 69% of the staff, followed by blacks 
(16%), Spanish surnamed (11%), American Indians (2%), and all 
others (2%). On a project basis, all but three projects had a 
majority of white staff members. Thus, whites accouhted f or a 
disproportionately high percentage of the staff vis a vis tLe 
ethnic distribution of the students, which had a higher percentage 
of Spanish surnamed individuals. 

Age Distribution 

The average age for all adult project staff members was 28. 
On a project basis, there vas limited variation ranging from a 
high of 38 to a low of 24. 

Native Languages 

Native English speakers accounted for 89% of the staff, 
followed by Spanish (9%), and American Indians (1%). On a 
project' basis, all but one had a majority of native English 
speakers. 

Language Fluency 

Besides English, Spanish was the only other language in 
which staff members were fluent (22%) . For the five projects 
serving primarily non-English speakers, at least 39% of the staff 
vas fluent in the students' native tongues, thus enabling them 
to teach in English and/or Spanish, 

Educational and Teaching Experience 

On an average, the staff members of the adult projects 
have attended 14 years of schooling. On a project basis, the 
variation ranged from a high of 17 to a low of 13. Thus, the 
staff members included a mix of high school and college graduates. 
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The average number of years of teaching was 2.6, with 
variations on a project basis ranging from alow of less than one 
year to a high of 7 years. i.o% of the overall staff had 
teaching credentials, with variations on a project basis 
ranging from a low of none to 67. 35% ©f the overall staff 
had had at least one formal course in reading instruction, with 
variations on a project basis ranging from a low of 14% to a 
high of 75%. Thus, generally the staff of the adult projects 
had had less education and training than the staff of the student 
projects. This was to be expected since the staff of aiult pro- 
jects included volunteers, as well as paid professionals, while 
the staff of the students projects primarily included paid 
professionals and work/study students. 

The above discussion consists of descriptive statistics 
on staff chaxacteristics for both the student and adult projects. 
The following paragraphs will simultaneously diccuss the cumula- 
tive staff sizes, termination rates, and reasons for termination 
for both the student and adult projects. 



Cumulative Staff Size 

The average cumulative (i.e., continuing and terminating) 
staff size for the student projects vas 16, with vetriations Oii a 
project basis ranging from a low of five to a high of 62. with 
the exception of three projects, staff sizes were usually 11 or 
under. Staff sizes for the student projects varied primarily as 
a function of staff deployment, with larger staffs using part- 
time personnel and small staffs using full-time personnel. 

The average cumulative staff size for the adult projects 
vas much higher at 42, reflecting the greater utilization of one- 
to-one volunteer strategies. On a project basis, staff sizes 
ranged from a low of 3 to a high of 121 , with all but three 
projects having staff sizes of 18 or higher. 



Termination Rates 

The average termination rate for the staff of the student 
projects vas 15. 4%.* On a project basis, termination rates vzuribad 
from a low of none to a high of 66.7%. (it should be noted that 
Project G, with the highest rate of 66.7%, experienced a change of 
program operations and terminations were primarily due to this 
shift.) 

The average termination rate for the staff of the adult 
projects was 27.2%. On a project basis, the rate varied from a 
low of none to a high of 78%. 



*It should be noted that termination rate* were based on the 
submission of the termination data form so that the more efficient 
projects may appear to have relatively higher termination rates 
than less efficient projects. Kowaver, we are confident that 
Q these rates are sttfll accurate as estimates. 
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(Tt should be noted that Project R, with the highest lenninat ion 
rate, had to reorganize its volunteer tutoring component result- 
ing in a high loss of tutors*) As expected, tutorial projects 
experienced higher rates of termination. However, two of the three 
volunteer tutorial projects had lower than average termination 
rates, indicating that a strong administrative effort and control 
process can limit the natural tendency towards high termination 
rat^iS among volunteer projects. 

Reasons for termination 

Reasons for termination were organized into two major 
cacegories — Dismissed auid Left Volun tarily — with sub-categories 
under each. (Since the data base for termination reasons was 
small, only percentage totals for all 24 projects are provided.) 

"Left Voluntarily" accounted for 90.2% of the terminations 
while "Dismissed" accounted for 9.8%. Thus, termination vas almost 
exclusively due to the staff members' voluntary decision to leave. 
Of those dismissed, 41% were dismissed for absenteeism, 12% for 
a lack in skills, and 47% for other reasons. Of those who left 
voluntarily, 40% left for personal reasons, 31% left for other 
employment, 29% left for other reasons, and 1% left because they 
were dissatisfied. 



Staff Questionnaire Responses 

The staff questionnaire was used to obtain staff judgement 
concerning overall project operations. The questionnaire was 
distributed during the post-test period. To insure confidential- 
ity, no names were required and self -addressed return envelopes 
were proirided. 

The questionnaire contained 28 statements separated into 
four major areas of inquiry — administration and organization, 
staff, students, and instructional program. The respondents 
were requested to circle "strongly agree," "agree," "disagree" 
or "strongly disagree" for each statement. In addition, three 
open-ended questions were included to obtain judgements on 
project success factors, and changes recommended for project 
improvement. Items were scored as follows: Strongly Agree«5, 
/.gree-4. No Response-3, Disagree-2 and Strongly Disagree*!. 
3ased on this scoring method the potential total score on any 
item is five, and any score of four or above is considered 
positive. Each item score for each of the four categories was 
then summarized to obtain sub-total scores per category, with 
a maximum score of 50 for administration and organization, 35 
for staff, 15 for students, and 40 for instructional program. 
This resulted in a maximum possible score of 140 for all items. 
Tables 47 and 48 present the results of the staff questionnaire 
responses based on this scoring process. 
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Prior to reviewing these responses the reader should be 
aware of the inherent limitations in interpreting the results. 
First, the data are presented for descriptive purposes only; 
definitive conclusions cannot be drawn since the data were 
not subjected to inferential analysis. Second, the number of 
respondents varies substantially between projects due primarily 
to the varying staff sizes and secondly to the varying response 
rates. 

In general, the overall responses for both models were highly 
positive, as indicated by total scores of 118 for the student 
projects and 115 for the adult projects (with a meLximum potential 
score of 140 if all "strongly agree" and a score of 112 if all 
"agree"). Only two student projects (Project C and Project J) 
and two adult projects (Projects V and R) fell marginally below 
the 112 positive score. 

Similar results ware obtained in analyzing the four sub- 
categories. For the administration and organization category, 
with a possible high of 50, the average score for the student 
projects was 44, with a range of 34 to 47 ; the average score for 
the adult projects was 41, with a range of 37 to 43L Only three 
student projects (Projects C, D, & J) and two adult projects 
(Projects V & R) fell below the score of 40 representing an 
"agree" or positive response. For the staff category, with a 
possible high of 35, the average score for the student projects 
was 29, with a range of 26 to 34; the average score for the 
adult projects was 30 with a range of 27 to 34. Only two student 
projects (Projects C & L) and three adult projects (Projects 
V, R & T) fell below the positive score of 28. For the student 
category with a possible high of 15, the average score for the 
student projects was 12, with a range of 11 to 13; the average 
score for the adult projects was 13 with a range of 12 to 14. 
Only four student projects (Projects C, E, J, & M) and two adult 
projects (Projects V & R) fell below a positive score of 12. 
For the instructional program category, with a possible high 
of 40, the average score for the student projects was 33, with a 
range of 30 to 37; the average score for the adult projects was 
33 with a range of 29 to 38. Three student projects (Projects C, 
J, & H) and four adult projects (Projects V, R, X, & P) fell 
below the positive score of 32. 

Thus, the general conclusion to be drawn from these results 
is that the staff of the community- based projects usually 
positive about their projects' administration and staff capabilities, 
had a positive attitude towards their students, and felt that 
the instructional program was organized in an effective manner. 
Since the responses to the questionnaire resulted in a limited 
degree of discrimination among projects, one may be sceptical of 
the results and tend to think that the questionnaire was not 
capable of discriminating between actual positive and negative 
judgments, while we have no definitive proof that this is not 
the case (since the questionnaire is not standardized) , our 
expectations — based upon our personal contact with project 
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administrators and staff — were thdt the responses would generally 
be positive. More specifically, with few exceptions, we found 
that the administration and staff were highly dedicated people, 
proud of their projects and feeling that they were doing as good 
a job as they could recognizing the inherent difficulties in 
operating these projects. 

A review of the open-c»nded, narrative responses also gener- 
ally supported these positive ratings and provided some interest- 
ing suggestions. For both the student and adult projects, the 
most often mentioned reasons for project success related to the 
enthusiasm and dedication of the staff; the good working relations 
and cooperation between staff, administrators, and students; and 
the motivation and interest of the participating students. 
Typical comments included statements like "imparting to students 
the feeling that someone cares" aad"the flexible, human, non- 
bureaucratic way of administrators." Other, less mentioned 
project success factors related to the individualization of 
instruction, the use of incentives for students, good staff skills, 
the use of one-to-one tutoring, the use of a variety of materials, 
flexible scheduling and location of instruction compatible with 
student availability, and the use of specific reading techniques 
(i.e., Laubach and Words in Color), 

The most often mentioned negative factors and/or suggestions 
for improvement for both student and adult projects related to 
the need for more resources — particularly for additional materials, 
staff, space, and not surprisingly, more pay for existing staff. 
Many people also recommended the development of better mechanisms 
to limit both student and staff turnover; the use of more effec- 
tive training progpams; and the availability of better diagnostic 
information of individual student reading deficiencies. 

Several of the student projects suggested the use of smaller 
classroom sizes and several of the adult projects suggested the 
availability of transportation for their students. 



In summary, the following major conclusions can be drawn 
regarding the staff characteristics of both the student and adult 
projects: 

• Females acoctmted for a much higher proportion of staff members 
than males, thus reflecting the typical sex distribution 

of staff in the teaching profession. 

• Whites were the primary ethnic group, followed by relatively 
equal numbers of blacks and Spanish surnamed. Thus, ethnic 
distribution was disproportionate to the students* ethnicity, 
which was predominantly black among student projects and 
Spanish surnamed among the adult projects. 
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• The average age of all staff members was -approximately 28 
years, with variations on a project basis ranging from 38 
to 24. 

• English vas the native language for over 85% of the staff, 
followed by Spanish, which v«s the only other language 
accounting for moie than 1%. Consistent with this, 
approximately 22% of the staff were fluent in Spanish, 
with fluency in other languages virtually non-existent. 
Generally, projects serving Spanish speaking students, 
had almost 50 % of the staff fluent in Spanish, thus 
enabling them to teach in both Spanish and English. 

• Staff members had at least a high school education, and 
most had either graduated or attended college, with the 
staff of the student projects generally having more years 
of schooling than the staff of the adult projects. The 
staff of the student projects usually also had had more 
teaching experience (i.e., 3.3 years), than the staff of 
the adult projects (i.e., 2,6 years). Most staff members did 
not have teaching credentials, and about half of them 

had taken at least one formal course in reading instruc- 
tion, with staff members of the student projects more likely 
to have had a credential and taken courses in reading. 

• The average cumulative staff size of the student projects 
was 16, and the average cumulative staff size of the adult 
projects vas higher at 42. Variations among staff sizes were 
substantial, with projects using one-to-one tutoring and/ 
or part-time staff having substantially larger staffs. 

• The average termination rate for the student projects was 
15.4% and 27.2% for the adult projects. While termination 
was typically higher among tutorial projects, some do better 
than average, indicating that attrition can be internally 
controlled using effective administrative practices. 

• Termination vas almost exclusively due to a voluntary 
decision on the part of the staff member. Staff members 
most often left for personal reasons, or to be employed 
elsewhere. 

• Finally, staff members were generally highly positive about 
most aspects of project operations. 
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CHAPTER IX 

ANALYTICAL FINDINGS g CONCLUSIONS 



Design 



The purpose of this chapter is to present the findings 
and inferences regarding 1) the reading growth of participants 
m the Right to Read projects and 2) the relationships between 
achievement and a multiplicity of student and project variables. 

Outcome Measures 

The primary outcome measures were raw and residual gain 
scores based upon pre- and post reading tests. The SRA Multi- 
level Achievement Series (reading and vocabulary) was used for 
the student projects, including four levels of difficulty, 
covering grades 1-12. For the SRA test, growth scale value 
(GSV) scores were used; the GSV is a derived standard score 
with a scale that equalizes the raw scores across all four 
test levels. 

The REAL test was used for the adult projects. This is a 
single level test of literacy ana raw scores were utilized. 

Testing was conducted on a pre- and post- basis, starting 
m December and ending in May. The calendar interval between 
pre- and post-testing was controlled to the extent possible. 
However , because of a host of internal program operational 
factors and the open-entry exit nature of student participation, 
actual time between testing varied within and among projects. 

The second outcome variable used was rate of termination 
(defined as the number of terminees -f cumulative enrollment) . 
Termination data were obtained through the collection of 
student data forms and additional input from the projects. 

Research Questions 

In order to operationalize the study objective^, a series 
of specific research questions were developed during the evalua- 
tion design phase. The questions provided the operational and 
analytical framework for the study. These can be stated as 
follows : 



1) will students, in both the student and adult models, demon- 
strate significant reading gain during the evaluation period? 

2) Does reading gain vary significantly among project types 
and individual projects? 

3) What are the termination rates of the individual projects 
and project types? 

4) What are the reasons given for termination ? Do terminees 
differ in terms of initial reading skill? 

5) Is there a difference in reading gain based upon the follow^ 
ing projecL characteristics? 

• Enrollment size 

• Form of instruction, i.e., class or tutorial 

• Class size and staff :pupil ratio 

• Credit or non-credit instruction 

• Budget allocations and costs per student 

• Ethnic matching of students & staff 

• Staff size and turnover 

• Staff rating of the program 

6) Is there a difference in reading gain based upon the 
following student variables? 

• Sex 

• Ethnicity 

• Age 

• Grade Level 

• Number of Weeks Enrolled 

• Native Language 

• English Fluency (for non-native English speakers) 

• Proportion of Attendance to Absenteeism 

• Reasons for Enrollment 

• Attitudes (as measured by the attitude scale for 

the four test sites only) 

• Amount of Instructional Hours 

• Days Between Pre- and Post-Testing 

• Employment status (for adults only). 

7) Is there a diCCerence in reading gain based upon the following 
staff education and experience measures? 

• Number of years of schooling 

• Number of years of teaching 

• Number of reading courses taken 



Analysis of variance and post hoc tests using Scheffe con- 
trasts were used to explore these relationships. 
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statistical Model for Ass es«;inq 
Gain in Reading Achievement 

As indicated in the previous section, we desired a wasure 
ot gain m reading achievement for the instructional period 
under investigation. Several significant problems are associated 
wicn oDtaming such a gam: Measuring instruments are not 
sufficiently precise that one unit of gain at one point of the 
scale is equivalent to one unit of gain at some other point. 
(In the case of the SRA test, the GSV sclae values were used 
which should tend to result in equal scale units. No such 
scale is available for the REAL since it has only one level.) 
We anticipate that the group participants entering the different 
programs will not have the same entering skills. In other words, 
the non-random selection procedure will lead to different 
characteristics among the participants of different projects. 

No known method is fully satisfactory for handling the 
problf -ns of unequal intervals or of non-equivalent groups 
entering the respective treatments.* The most widely used proce- 
dure for attempting to meet these problems is simple gain scores. 
This procedure is known to have important drawbacks. (For 
example, simple gain scores are usually negatively correlated 
with initial scores, i.e. regression toward the mean leads 
persons with a low initial score to tend to have high gain 
scores and vice versa.) 

Since simple gain scores are widely used, we will report 
them in the tables which follow. We will, however, not emphasize 
them in the discussion and inferences. 

An alternative procedure is that of using residual scores 
(Cronbach & FurbV/ 1970). This procedure involves using one 
or more independent variables to predict the dependent variable, 
and then measuring the deviation of the observed scores from 
the predicted scores. This procedure is similar to the analysis 
of covariance, but decisions are made regarding the covariants 
before group differences are examined. While initial scores used 
as a covariate in the analysis will tend to remove part of the 
initial group differences, we must bear in mind as we examine 
the results the fact that this method is not totally satis- 
factory. This procedure represents in our judgment the best 
approach given the circumstances. 

The prediction of the dependent variable was based upon 
a multiple regression analysis. Predictor variables were 
included in the equation i^ they accounted for an additional 
2% of the variance in a stepwise procedure. 



A full discussion of this problem can be found in the Pacific T & TA 
Evaluation Design Report (September 1973). 
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For both the student and adult models only the pre-test 
score met the criteria. The regression equation for the student 
projects test scores was 48.07 + (pre-test score x .905). 
Both of these parameter estimates are significant from zero 
(p-C.Ol). The associated R2 was .89 indicating about 89% of 
the variance in the post-test scores was accounted for by 
prediction from pre-test scores. The regression equation for 
the adult project test scores was 13.34 + (pre-test score x 
.652). Both of these parameter estimates are statistically 
significant from zero (p 4 .01). The associated r2 was .45 
indicating about 45% of the variance in the post-test scores 
was accounted for by predictions from the pre-test scores. 



Missing Information on the SRA & REAL Tests 

As indicated in the previous chapters, the problem of 
missing information existed for both the REAL and SRA tests. 
Missing data existed for two main reasons: First, the individual 
did not have both a pre- and post-test, either because the pro- 
ject did not test that person, or because the person left the 
project without a chance to conduct testing. In this case, 
nothing can be done. Second, the individual involved was tested, 
but part or all of the responses to the test items were missing. 

The situation in which partial information about an individual 
was available may be classified into three types: (1) the 
individual was not tested because the instructor judged 
the student could not do any part of the test; (2) the 
individual failed to complete parts of the test, by his/her 
own decision to stop; or (3) the individual completed only 
part of the test because the teacher did not present those parts 
of the test which the teacher judged to be too difficult for 
the student. 

As noted in (1) above, there were instances where teachers 
did not administer the test because they judged it to be too 
difficult for the students; this provides important information 
about those students and it must not be excluded from the 
study (since such exclusion would constitute an over-estimation 
of the ability of the total group being assessed) . It is also 
not appropriate to consider their score zero, because our observa- 
tions indicate no one who actually attempted the test scored 
that low. A compromise decision is to conclude that such a de- 
cision is an indication of a low score and therefore the score 
corresponding to the fifth percentile of the sample of testees 
in this study was assigned to these individuals. 

Norms for the REAL are available only for the total test 
scores. Therefore, if an individual responded to less than 
nine items on the test, the total score is not comparable with 
the norms or t^'^'- scores of other persons who responded to all 
nine items. Therefore a scoring procedure was developed which 
used the partial information to estimate what the total test 
score would have been. 
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The scoring procedu>-e for the REAL does not contain a 
procedure for handling a pc?ri-ially completed test, although 
it seems clear that a partial test contains some useful infor- 
mation about the achievement of the individual tested. 

The correlations among the nine items of the REAL test 
ranged from .50 to .70 with a median of .62. These correlations 
indicated the test was highly homogeneous and therefore the 
following procedure was developed for scoring under these 
circumstances . 

Missing information was estimated by converting the observed 
scores on each available scale to standard scores by subtracting 
the mean of the scale and dividing by the standard deviation of 
the scale. The means for the nine scles were: 3.2, 2.0, 1.7, 
1.8, 2.8, 2.0, 2.8, 1.9, and 3.5. The standard deviations for 
the nine scales were: 1.8, 1.6, 1.6, 1.7, 1.6, 1.9, 1.8, 1.9, 
and 1.3. 

The mean standard score for the scales which were available 
was calculated. The resulting "mean standard score" was used 
to estimate the score for each scale which was missing by 
multiplying it by the standard deviation for that scale. 

The resulting estimated scale values were then used in 
the same way as observed values were used in calculating che 
total score for individuals. The nine scales in the REAL are 
not weighted the same in the total score and this estimation 
procedure allowed the weighting to remain the same and at the 
same time produced scores from partial response information 
which may be reasonably expected to be on the same scale as 
scores from tests with a complete set of responses. 

SRA Test — Since this test is composed of two parts, 
rtial data were sometimes received in which only one 
e the parts (either reading or vocabulary) was completed. 
Since total GSV scores were used, completion of one part of 
the test could not be compared directly to the total test. 

A similar correlation analysis was undertaken to test 
the homogeneity of these two parts which indicated that the 
correlation was not strong enough to predict the total score 
from the partial score. Accordingly, only students for whom 
completed pre- and post-tests were available, were used in the 
analysis. 

Missing data based on the teachers' judgement that the 
test was too difficult rarely occurred for the SRA test 
because the test had multiple levels of difficulty. 



O 125 

ERIC 



Based upon these procedures, the following sections 
discuss our findings for the student projects first and adult 
projects second. Each table includes the following: the 
identification of the variable under investigation, the sample 
size (N) , the pre-test score and its standard deviation, the 
gain score and its standard deviation, and the residual score 
and its standard deviation. The discussion of the find- 
ings is limited to residual gain scores, except in the 
discussion of overall gain. In this case the residual gain score 
by definition is equal to zero. Therefore, raw gain scores 
are used as the primary measure. 



Student Projects 



Initial Skill Level 



The students' mean initial skill level, as measured by the 
SRA GSV pre-test scores (Table 49) , was 331 with a standard 
deviation of 72. This is equivalent to a 6-6 grade level 
(based upon SRA norms). 

On an individual project basis, the pre-test scores vary 
from a low of 209 to a high of 415. An analysis of variance 
indicated that the projects differed significantly in this 
respect and thus the target groups represent different popula- 
tions in terms of reading skills. As expected, the pre-test 
scores are related to the degree of educational attainment 
with college students performing the highest (projects A, B, 
C, D) followed by senior and junior high (projects E, G, H, 
I, J, K, L, M) and then elementary students (project F) . 

Given the traditional grade equivalent definitions of 
functional literacy (i.e., 5th grade), most of the students 
in the Program are not illiterates, but are underachievers 
who are performing below the norm and in need of remedial 
help. 

Overall Gain 

The mean gain* of the 788 students with pre- and post- 
test scores was 16.73 with a standard deviation of 33.90 
(Table 50). 



The most commonly used measure of change is 'simple gain. Although 
this measure has important methodological problems, it is reported here, 
since it is most appropriate for overall conclusions. 
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This gain is statistically significant at the .05 
confidence level. The 95% confidence interval (based upon t 
distribution) for the mean gain of students in the R2R program 
is 16.73 + 2.37. 

This offers convincing evidence that, as a whole, the 
participants in the student model improved their reading 
performance during the period under study - 

It is necessary, however, to set this conclusion in its 
proper context. Namely, is this amount of gain more than would 
normally be expected? 

In view of the fact that these students were selected 
because they appeared to have problems with reading, we would 
expect that their progress in reading would generally be 
below average. Examining the SRA norms (SRA, 1972) for the 
average students in their norming population, we find that 
students with a GSV of about 330 would be expected to show an 
average yearly gain of about 25 points (or 12 points for 
five months). In this light, the mean gain of 16.73 for the 
Right to Read (R2R) student for a mean period of approximatelv five months 
indicates substantially more gain than "average" students are 
achieving in the time involved. 

Thus , in general, we conclude that participants in the 
student model demonstrated significant change in their reading 
skills during the evaluation period and that this change 
indicates a growth rate which is better than the "average" 
for students with the same entry-level reading skills. 



Project Typology Gain 

Table 51 presents the analysis of residual gain based upon 
the three previously defined project typologies (Chapter IV) . 
Significant differences do exist and based upon post hoc test 
U3ing Scheffe contrasts. Type I performed the best, followed by 
II and III respectively. 

Thus the following conclusions can be made: first, class- 
room projects are more effective than tutorial projects- Second, 
projects that operate within the regular school structure are 
more effective than those operating outside this structure. 
This suggests that the more integrated a R2R project is with 
the normal school operations, the more effective it is in 
generating improvement. Evidently, these projects are able 
to capitali:^e on the regular school resources and instructional 
strategies so that P2R impact is supportive of and supported 
by regular instruction. 
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As indicated in Table 52 , there are significant differences 
i n residual gains among the 13 student projects ? and thus it 
can De concxudea tnat some projects are more effective than others 
Post hoc comparisons by means of Scheffe contrasts indicated that 
projects G, D, & B were the most effective and significantly 
different than projects E, F, & I. 

A crucial question for policy makers is to try to deter- 
mine what features of these projects in fact were influential 
in their impact on progrsun effectiveness. The complex and 
correlated nature of the numerous program variables makes it 
difficult to accurately answer this question on rigorous analy- 
tical grounds. However, a more descriptive approach was taken 
to try to single out important and effective program features. 
More specifically, the projects were ranked in order of effective- 
ness and then compared on the basis of the following variables: 
pre-test score, cumulative enrollment, form of instruction, 
class size, staff;pupil ratio, school credit, percentage of total 
budget expended for personnel, monthly cost per student, dominant 
student ethnicity, percentage of staff having the same ethnicity 
as the dominant student ethnicity, staff size, staff termination 
rates, and staff questionnaire ratings (presented ii Table 53). 



Examination of these findings reveals that projects with 
higher pre-test scores are generally more effective than projects 
with lower pre-test scores, suggesting that, for the R2R popula- 
tion, greater improvement was more frequently achieved among 
students with more advanced entry skills than among those with 
more minimal beginning skills. However, none of the many other 
factors examined showed a consistent relationship to student gain . 
With regard to several key factors, this finding derives frcpm 
the fact that projects were so similar that no differentiations 
could be made: thus, all projects had a high degree of ethnic 
correspondence between students and staff: all projects spent 
the bulk of their monies on personnel? and all projects were very 
positively rated by their staffs. More variation was found in 
relation to such factors as staff? pupil ratio (from 1:4 to 1:12) 
and class size (from 5-23), but no systematic differences were 
found and this is consistent with expectations based on the litera 
ture. Large variations were noted in monthly cost per student, 
size of enrollment, and staff size and termination rate. However, 
none of these factors were systematically related to student out' 
come either. It would appear that project effectiveness is more 



128 



a function of an ideal and complex mix of program features, 
and organizational and teaching quality, than of individual , 
discrete program variables. 

Termination Rates 

The second major dependent variable evaluated in this 
study was the student termination rates (defined as # terminated 
f cumulative enrollment) . Table 54 presents the overall termina- 
tion rate and rank order of rates on a project basis, and Table 
55 presents the termination rates on a project typology basis. 

The overall termination rate is 23.0% which compares favorably 
tn^ similar literacy programs which were found to have termination 
rajb:i 5 oft en above 50% {see Chapter I). On a projebjt typology basis; 
Type I had the lowest rate (15%), followed by Type III (28%), and 
Type II (36.3%) . 

In judgmentally assessing the program features in relation 
to projects* ability to retain students, none of the major 
program variables seem to reflect retenticsi effectiveness. However, 
it does seem that those projects which performed better on 
reading gain also performed better on retention. This suggests 
that projects which have effective management and organizational 
approaches and quality instruction will produce both the best 
results in terms of reading performance and student retention. 
Moreover, based upon the typology rates, more structured projects, 
i.e., Type I, retain their students more effectively than less 
structured or tutoring projects. 

Reasons for Termination & 
Reading Skills of Terminees 

Table 56 presents a frequency distribution of the reasons 
identified for termination. In total , termination is almost 
equally due to student withdrawal (10. 0%) and project drops (11.2%) , 
indicating that termination is both a function of student and 
project decisions. The primary reasons for withdrawal are: 
moving (1.9%), time conflicts (2.4%), lacking interest (2.9%). 
The primary reason for dropping students is non-attendance (10.3%). 
In terms of the initial reading skills of the terminees vs. 
continuees (Table 57), it was found that the terminees' mean 
pre--test score was 310 vs. 338 for the continuees, which is 
significantly different (p <.05). We can conclude, therefore, 
that terminees have somewhat lower reading skills upon entrance 
than the continuees, and may be harder to hold. 
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Gain by Student Characteristics 



Tables 58 through 67 present the residual gain scores 
for the participants in the student model based upon the previously 
identified student characteristics. The following is a discussion 
of these gains as th^ relate to significant differences between 
these groups. 

Sex — No significant differences exist between the gain 
made by males and females. 

Ethnicity — On an ethnic basis, significant differences 
eunong groups were founi on both the initial test and residual 
gains. Scheffe contrasts indicated black students scored 
higher on the initial test than white and Spanish-surnamed 
students, who did not differ. In terms of residual gain> both 
black and Spanish-surnamed students gained more than white students. 

This finding must be viewed, however, in the context of 
the students* project assignment since students were not randomly 
distributed on an ethnic basis? thus, it is therefore impossible 
to separate individual factors from program effectiveness. It 
should also be noted that the black and Spanish-surnamed students 
entering this program have higher ability than the white students 
entering the progrsun, and our findings indicate that students 
with higher entering skills achieved the most. 

This confounding context, however, does not detract from 
the importance of the finding, particularly since much prior 
research has suggested that minorities do not perform as well 
as whites on achievement tests. 

A<^e & Grade Level Completed — On both an age and grade 
completion basis, significant differences among groups were 
found in both initial scores and residual gain scores. 

In both cases, examining the difference by Scheffe contrasts, 
significant linear trends were found. This indicated that the 
' older the students, or the more schooling they had completeS^ 
the better they did on the initial test, and the more they 
gained in terms of residual gain scores. 

This finding may be interpreted as indicating that it is 
iiu:>re difficult to induce improvement in a short period of 
time (such as the evaluation period) for students with limited 
or no reading skills than to upgrade the skills of more advanced 
students. 
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Thus it must be recognized that the task of improving 
the reading skill of illiterates and functional illiterates 
among youth vis a vis more advanced students, is a more difficult 
objective that will require longer periods of time. Moreover, 
from R2R's perspective, while the need to improve college 
students* skills is not unimportant, it seems more important 
to be able to effectively serve the younger age group of 
students since they are the potential future members of the 
functionally illiterate population. 

Native Language — In terms of the two primary native 
languages, English and Spanish, native English speakers scored 
higher on the pre- test than native Spanish speakers. However, 
the two groups did not differ in terms of residual gain scores, 
indicating that both groups benefitted from the program. 

Able to Read Native Language (if not English) — Students 
who can read their native language scored significantly higher on 
the pre-test than the non-readers of their native language. 
The two groups, did not differ, however, in their residual gain. 

Fluent in Spoken English (if native language is not English) 
Those who were fluent m spoken English scored significantly 
higher on the pre-test, but the two groups did not differ in 
residual gain. 

Weeks of Enro ll ment — In terms of weeks of enrollment, 
there were significant differences among groups of students 
on both the initial test and residual gain. Examining both 
of these significances by means Scheffe contrasts on pairwise 
comparison and linear and quadratic trends did not reveal a 
simple interpretablG relationship. 

Proportion of Attendance — Students were grouped into 
four categories based upon the proportion of class sessions 
which they attended (i.e., # attended 4 total # classes 
available) : 



The initial scores of the four attendance groups differed 
significantly. This significant difference was examined by 
Scheffe contrasts on pairwise comparisons which indicated that 
the lower attendance group scored u^wer than the other three 
groups and that the three higher groups did not differ on 
initial score. 



Category 1 
Category 5 
Category 3 
Category 4 



90-100% attendance 

80-90% attendance 

60-80% attendance 

< 60% attendance 



The residual scores of the four attendance groups differed 
signi f ican tly , i.e., those who attended a higher proportion of 
available classes did better "than those who attended a lower 

proportion* This significant difference was examined by 
Scheffe contrasts on pairwise comparisons which indicated that 
the lowest attendance group scored lower than the two higher 
attendance groups. Thus this finding may suggest that students 
who are motivated to regularly attend R2R classes achieve more 
than students who attend less frequently. 

Reasons for Enrollment — The "reasons for enrollment" item 
on the data form allowed multiple reasons to be checked and 
therefore the responses were not mutually exclusive. 

The results indicate that students who checked the item 
"referred by counselor" did more poorly than those who did not. 
On the other hand, students who indicated a self -motivating 
purpose, i.e., wanted to learn to read, wanted to handle life 
situations better, to get a job, or other, did better than 
students who did not indicate such motivation. 

Thus, students who perceive their participation as voluntary 
and related to the accomplishment of specific goals achieve more 
than student whose participation is perceived as non-voluntary . 

Attitude — An attitude scale (as discussed in Chapter 2) 
was administered at two student projects (C & E) . The attitude 
scale scores were correlated with reading gain, and the correla- 
tion between favorable attitude score and residual gain score 
was .10 (N=73). This correlation is not statistically signifi- 
cant from 0 (pjb^.20). As noted above, however, there was a 
relationship between regularity of attendance and gain, and that 
may be a more effective measure of attitude than a paper and 
pencil test. 

Hours of Instruction — As indicated in the previous chapters, 
students within and among projects, received widely varying 
amounts of instructional hours. Based upon the regression 
analysis, however, no significant relationship existed between 
gain and hours of instruction. 

This finding, on initial inspection, seems to be contra- 
dictory with other research, most of which suggests that more 
hours will produce more gain. However, several reasons seem 
to account for the lack of a relationship in this study: 
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First, many students received much less than 100 hours 
of instruction and the differences in the resulting achievement 
are probably small compared to the large variety of other 
influences involved. In other words, the power to detect 
differences in- outcomes due to differential hours of instruction 
is low. Second, the study only compiled instructional hours 
received in R2R, and did not include hours received in other 
classroom instruction or homework/self instructional hours. 
Third, the study was not designed to try to differentiate among 
varying levels of instructional quality; a factor which is 
generally regarded as the prime determinant of impact and more 
important than quantity (and a variable that has eluded quan- 
tification in almost all similar research) . Given the factor 
of quality, and other important program factors, an hour (or 
ICO hours) of instruction in one project is not necessarily 
equivalent to an hour in another project. 

Thus it seems more logical to assume that the study was 
unable to isolate and control for hours of instruction, rather 
than conclude that, in fact, no relationship exists between 
hours and gain. 

Days Between Testing — A similar situation is faced when we 
compare gain to the number of days between pre- and post-testing. 
As identified in earlier chapters, the days between pre- and 
post-testing varied within and among projects, due to varying 
project schedules and the flexible nature of student participation. 
The regression analysis, however, indicates that no significant 
relationship was found and thus more days of participation does 
not necessarily generate more gain. 

As with the previous finding, we are hesitant to conclude 
that there is no relationship, but that other intervening and 
related factors, i.e., program managment and quality, are more 
important. In any event, we can conclude that an effective 
project can produce gain in a short period of time (as evidenced 
by projects A and B, for example, which operated on a semester 
basis) , while an ineffective project will produce less gain 
even given longer periods between testing. 



Gain by Staff Characteristics 

As indicated earlier, students were matched with their 
respective teachers or tutors. In an effort to identify if 
any relationship existed between certain staff characteristics 
and student gain, residual gain scores were compared in the cases 
of three staff characteristics pertaining to experience: number 
of years of schoolif'- number of years of teaching experience, and 
number of reading c ..r.-es taken. Tables 68-70 present 
the results, indica. that no significant differences exist 
among students who have teachers/tutor with different levels 
of experience and education. 
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Table 49 



BEST COi'Y 



PRE-TEST SRA SCORES 



Student Projects 



N 



Pre-Test 



Project A 
B 
C 
D 
B 
P 
G 
H 

I 

J 

m 

L 
M 



38 
327 
25 
9 
61 
21 
35 
47 
31 
16 
28 
97 
53 



415.42 v44.61) 

359.62 (48.40) 

389.56 (52.20) 

359.00 (76.62) 

267.44 (60.42) 

209.14 (66.07) 

235.34 (71.75) 

319.38 (56.83) 

309.77 (86.03 ) 

353.06 (50.39) 

358.07 (40.43 ) 
303.49 144.77 ) 
284.79 C74.43 ) 



POPULATION 
MEAN 



330.09 (72.26) 



Table 50 

SRA GAIN SCORE FOR 
ALL STUDENT PROJECTS 



N 



Pr«-Test 



Gain 



788 



330.09 (72.26) 



16.73 (33.90) 
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Table 5i 

RANK ORDER OF STUDENT PROJECT 
TYPOLOGY SRA GAIN SCORES 



BEST COPY Av:/; 

Residual 



Type 




Pre-Test 






Gain 






Gain 




I 


544 

^ ^ 


342 03 ffid 










S • 


■> T /Oft 

37 (29. 


87) 


II 


155 


307.79 (88. 


42) 


14. 


06 (38. 


99) 


-4. 


79 (39. 


38) 


III 


89 


295.96 (69. 


15) 


7. 


73 (36. 


50) 


-12. 


24 (37. 


08) 

1 
1 



F (2.785) « 

26.34 
p < .05 



F (2.785) 
10.72 

p<: .05 



student . 
Projects- 



Table 52 

RANK ORDER OF INDIVIDUAL 
PROJECT SRA GAIN SCORES 



N 



Pre-Test 



Gain 



Residual 
Gain 



G 
D 


35 
9 


259.34 
351.00 


(71.75) 
(76.62) 


37. 
23. 


86 

56 


(54.76) 
(20.83) 


12.13 
9.57 


(51.51) 
(24.89) 


B 


327 


359.62 


(48.40) 


21. 


32 


(29.45) 


7.39 


(27.63) 


M 


53 


284.79 


(74.43) 


21. 


72 


(44.65) 


.69 


(44.09) 


J 


16 


353.06 


(50.39) 


14. 


75 


(23.43) 


.20 


(26.86) 


A 


38 


415.42 


(44.61) 


8. 


76 


(22.69) 


.14 


(21.25) 


K 


28 


358.07 


(40.43) 


13. 


93 


(25.20) 


-.15 


(23.88) 


C 


25 


389.56 


(52.20) 


6. 


64 


(24.70) 


-4.44 


(23.45) 


L 


97 


303.49 


(44.77) 


12. 


99 


(28.05) 


-6.27 


(27.51) 


H 


47 


319.38 


(56.83) 


9. 


06 


(28.16) 


-8.68 


(26.31) 


I 


31 


309.77 


(86.03) 


6. 


48 


(41.99) 


-12.18 


(40.96) 


E 


61 


267.44 


(60.42) 


3. 


65 


(37.45) 


-17.79 


(40.75) 


F 


21 


209.14 


(66.07) 


10. 


14 


(46.78) 


-18.07 


(49.56) 






F (12,775) = 

47.65 
p< .05 








F (12, 
5. 

p ^ . 05 


775) = 
01 



While Project 'tf is primarily a program serving white college students 
only the Spanish sumamed group component was pre- and post-tested since ' 
Q the white college group "peaked out" on the pre-test. 
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Table 54 ^^"^ ' 

RANK ORDER OF STUDENT PROJECT TERMINATION RATES 



Student Projects 



Termination Rate % 



Rank Order of 
Residual Gains 



POPULATION i4EAN 



B 


.4 


3 


D 


13.9 


1 


J 


15.6 


5 


A 


21.1 


4 


K 


25.2 


6 


L 


27.2 


9 


M 


28.6 


7 


C 


35.3 


8 


F 


35.6 


13 


H 


36.1 


10 


E 


38.4 


12 


G 


47.3 


2 


I 


62.5 


11 



23.0% 



Table 55 



Type 



I 
II 
[III 



RANK ORDER OF STUDENT PROJECT 
TYPOLOGY TERMINATION RATES 

Termination Rate % 



15.0 
36.3 
28.0 



Rank order of 
SRA Residual Gain 




1 
2 
3 
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N 



245 



SEX 



Male 



! Female 



Table 5 7 

COMPARISON OF SRA PRE-TEST SCORES 
BETWEEN TERMINEES & CONTINUEES 



BEST C:. 



Terminees 



Pre~Test 



309.65 (81.11) 



Continuees 



N 



Pre-Test 



1093 



337.80 (76.57) 



N 



Table 58 
SRA GAIN BY SEX 
Pre-Test 



t (1,1336) 
=13.31 
P <.05 



Gain 



Residual 
Gain 




372 
380 



330.12 (78.09) 16.89 (35.12) -.09 (35.10) 
329.58 (65.40) 16.72 (32.55) -.07 (31.30) 



I 



P (1,750) = 
.01 

NS 



F(l,750) = 
.0001 

NS 



ETHNICITY 



Black 

White 

Spanish 
Surnamed 

American 
Indian 

Asian 

Other 



ERIC 



Table 59 
SR." GAIN BY ETHNICITY 




479 
154 

112 



8 



346.85 (64.85) 

298.33 (63.87) 

300.61 (86.46) 

286.00 (63.58) 



364.50 (79.99) 



F(4,754) = 
21.82 



p< .05 



17.42 (30.29) 
12.17 (33.82) 



2.20 (29.56) 
•6.93 (35.13) 



20.90 (43.44) 1.37 (41.29) 



-4.83 (42.90) -25.75 (41.45) 



14.50 (31.25) 1.04 (34.90) 



F(4,754) 
3. 22 

p < . 05 
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Table 60 OLST C:. V . 

SRA GAIN BY AGE 

Age N Pre-Test Gain Residual Gain 



1 ^ 14 


92 


261.62 


(63. 


16) 


11. 


15 


(33.53) 


-12.43 


(34. 


41) 


Il4< 17 


241 


300.04 


(67. 


48) 


13. 


80 


(37.95) 


-5.37 


(38. 


21) 


;i7^ 21 

« 

< 


252 


354.79 


(56. 


88) 


18. 


04 


(30.24) 


3.65 


(29. 


08) 


|21< 34 


135 


372.73 


(55. 


63) 


19. 


58 


(27.60) 


6.90 


(25. 


78) 


'34 < 43 


23 


389.00 


(42. 


90) 


16. 


83 


(27.33) 


5.69 


(26. 


24) 


'43-^ 64 


7 


367.71 


(31. 


82) 


26. 


86 


(28.70) 


13.70 


(3C. 


82) 



F(5,744) F(5,744) 
«62.04 « 6.41 

p ^ .05 P < -05 



Table 61 



Grade 



N 



SRA GAIN BY GRADE LEVEL COMPLETED 



Pre-Tfest 



Gain 



Residual 
Gain 



2 


4 


165.75 


(51.40) 


-27.75 


(63. 


70) 


-60.08 


(67.24) 


3 


3 


224.00 


(50.27) 


10.00 


(95. 


29) 


-16.80(100.04) 


4 


4 


249.50 


(40.77) 


0 


(14. 


45) 


-24.38 


(13.65) 


5 


22 


250.32 


(50.18) 


20.57 


(27. 


06) 


-5.62 


(26.40) 


6 


28 


252.68 


(63.12) 


23.14 


(35. 


33) 


-.94 


(33.90) 


7 


29 


263.93 


(61.80) 


9.83 


(41. 


02) 


-13.18 


(39.26) 


8 


188 


291.48 


(63.56) 


14.39 


(39. 


71) 


-5.48 


(39.26) 


9 


44 


321.96 


(53.25) 


9.39 


(30. 


12) 


-8.12 


(30.49) 


10 


28 


362.43 


(55.34) 


11.96 


(25. 


38) 


-1.70 


(25.48)1 


11 


24 


374.63 


(55.54) 


4.67 


(28. 


96) 


-7.84 


(32.17) 


12 


306 


364.60 


(53.52 


20.90 


(28. 


72) 


7.44 


(26.80) 


13 


49 


368.27 


(46.09) 


10.35 


(26. 


09) 


-2.76 


(24.48) 


14 


5 


393.20 


(56.29) 


19.40 


(29. 


48) 


8.66 


(30.78) 



ERIC 



F{15,753) 
-28.35 
p-C .05 
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F (12,753) 
= 3.45 
p< .05 



Table 62 



BEST ro: • 



SRA GAIN BY NATIVE LANGUAGE 
Native Language N Pre-Test Gain 



Residual 
Gain 



English 
Spanish 



659 333.29 (69.18) 15.69 (31.80) -.64 (31.79) 
100 298.87 (83.67) 22.43 (42.69) 2.47 (40.94) 



P(l,757) 

= 10.14 
p <: .05 



P{1,757) 

= .45 
NS 



Table 53 



Able to Read 



SRA GAIN BY ABILITY TO READ 
NATIVE LAKCUAGE (IF NOT ENGLISH) 



N 



Pre-Test 



Gain 



Residual 
Gain 



Yes 


75 


306. 


51 


(83. 


75) 


20. 


00 


(42.98) 


1.03 (42. 


05) 


No 


18 


278. 


11 


(91. 


64) 


29. 


94 


(45.81) 


8.28 (40. 


82)' 

! 



F(l,91) 
« 8.07 
pii , 05 



F(l,91) 
= .54 

NS 



Table 64 



ERIC 



SRA GAIN BY FLUENCY IN SPOKEN ENGLISH 
(IF NATIVE LANGUAGE IS NOT ENGLISH) 



Fluent in English 



N 



Pre-Test 



Yes 

No 



F(l,95) 

«• 19.81 
P < .05 
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Gain 



Residual 
Gain 



80 318.46 (78.47) 
17 229.47 (53.62) 



16.71 (37.35) -1.12 (36.75) 
37.59 (49.23) 11.31 (47.90) 



F(l,95) 

«1.43 
NS 



Table 65 
SRA GAIN BY WEEKS OP ENROLLMENT 

Residual 





si 


Pre-Test 


wam 




Gam 




4-8 


3 


293.67 


(39.50) 


13.00 


(26.51) 


-7.19 


(28.65) 


8-12 


270 


356.87 


(52.18) 


19.17 


(27.18) 


4.99 


(25.22) 


12-16 


65 


285.57 


(87.33) 


28.97 


(45.49) 


8.01 


(42.13) 


16-24 


121 


303.92 


(57.95) 


11.96 


(31.00) 


-7.26 


(30.86) 


24-32 


151 


305.54 


(77.06) 


19.32 


(40.18) 


.26 


(40.18) 


32-40 


129 


349.58 


(76.37) 


5.46 


(29.30) 


-9.62 


(31.15) 


40-52 


7 


230.43 


(50.85) 


25.00 


(58.49) 


13.09 


(72.77) 


>S2 


14 


344.57 


(88.79) 


14.86 


(21.55) 


-.50 


(25.97) 



F(7,752) F(7,752) 
- 19.74 « 4.06 

p .05 .05 



Table 66 

SRA GAIN BY PROPORTION OF TIMES ATTENDED 

Proportion of Residual 
Attendance N Pre-Test Gain Gain 



.9^1.0 


270 


331.08 


(64.40) 


21.53 


(30.98) 


4.89 


(29.75) 


.8^.9 


219 


336.20 


(69.08) 


17.17 


(33.92) 


1.02 


(32.61) 


.6< .8 


203 


327.42 


(77.36) 


13.90 


(33.39) 


-3.09 


(32.95) 


0< .6 


79 


305.56 


(81.17) 


7.54 


(43.15) 


-1L51 


(43.89) 



F (3,767) » p (3,767) 

3.71 5.82 
.05 p<: .05 
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Reasons 



Table 67 

SRA GAIN BY REASONS FOR ENROLLMENT 
N Pre-Test Gain 



Residual 
Gain 



Counselor suggested: 

Yes 
No 

Want to learn to read: 

Yes 

No 

Do better in school: 

Yes 
No 

Handle life situations 

Yes 

No 

Get a job: 

Yes 
No 



Other : 



Yes 
No 



256 314.03 (77.28) 

513 337.19 (68.23) 

605 331.94 (71.40) 

164 320.43 (74.37) 

354 320.77 (76.70) 

415 336.91 (67.24) 

197 324.79 (75.82) 

572 331. XO (7^.82) 

177 331.88 (75.74) 

592 321.46 (70.94) 

57 309.37 (97.89) 

712 331.09 (69.52) 



11.65 (34.11) -6.60 F(l,767) 

-14.97 



19.16 (33.28) 
18.05 (32.79) 



3.10 



p<. .05 



1.49 F(l,767) 
= 6.83 

11.56 (36.63) -6.09 p < . 05 



16.48 (34.74) -1.13 F(l,767) 



16.81 (32.88) 



.73 



8.32 



25.55 (36.40) 
13.60 (32.22) -3.04 



«.50 
NS 

F(l,767) 
=17.64 
p <- . 05 



24.59 (37.96) 7.04 F(1.767) 



14.29 (32.01) -2.27 



=10.93 
p<r . 05 



29.90 (45.18) 11.20 F(1.767) 

«7.27 



15.60 (32.45) -1.03 



p < . 05 



\ 



143 



Table 68 

SRA GAIN BY STAFF NUMBER OF 
YEARS OF SCHOOLING 



BEST COr; /..'■' 



Residual 



# Years 


N 


Pre 


-Test 




Gain 




Gain 




< 12 


19 


247.94 


(60.82) 


17. 


95 (57. -^S) 


-8. 


12 (57.32) 


13£14 


61 


316.71 


(b9.45) 


14. 


93 (28.60) 


-4. 


12 128.26) 


15<16 


203 


343.81 


(61.83) 


18. 


66 135.60) 


3. 


36 (34.82) 


>16 


318 


341.14 


(85.12) 


18. 


58 (33.15) 


2. 


66 (32.21) 



# Years 



N 



F(3,597; 
-17.60 
.05 

Table 69 

SRA GAIN BY STAFF NUMBER OF YEARS 
TEACHING EXPERIENCE 

Pre-Test Gain 



F(3,597) 
-1.38 

NS 



Residual 
Gain 



< 1 
2^5 
6^10 

>x0 



341 
0 
25 
352 



326.6' (66,29) 



16.81 (34.56) -.52 (34.26) 



333.12 (64.34) 7.24 (37.48) -8.28 (37.60) 

339.97 (84.85) 18.19 {3x.99) 1.82 (31.04) 



F(2,715) 

-4.17 
PC .05 



F(2,715) 

-1.34 
NS 
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# Courses 



N 



Table 70 

SRA GAIN BY STAFF NUMBER OF 
READING COURSES TAKEN 



Pre-Test 



Gain 



Residual 
Gain 



0 


654 


332.77 (74.82) 


17.70 


(33.94) 


.98 


(33.24) 


1-2 


35 


349.65 (67.91) 


9.86 


(27.54) 


-6.31 


(26.24) 


3-4 


14 


378.04(;02.16) 


15.21 


(23.94) 


.32 


(26.90) 


>4 


0 










1 



F(2,700) 
-8.92 
p< .05 



F(2,700) 
= .82 

NS 
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A duU Projects 



Initial Skill Level 

The adult project students' overall initial skill were 
measured by the REAL pre-test scores. As indicated in Table 71, 
the mean REAL pre-test score was 19.88, with a standard deviation 
of 11.98. On an individual project basis, the pre-test scores 
vary from a low of 14.55 to a high of 34.39. Thus, based upon 
the test criteria of functional literacy equaling a raw score 
of 36, the projects are generally serving fun ctionally illiterate 
and marginally xiterate aduitsT ^ 

Overall Gain 

Based upon the same analytical procedures used in assessing 
SRA gains, overall gains were computed for the adults. The 
results indicated that an overall gain of 6.15 was achi eved 
iiv-the adult stu dents. This is statistically significant at the 

.05 level. The 95% confidence interval is 6.15 + 1.03 (T?ible 

72). 

Thus it can be concluded that students in the R2R adult 
project improved in their reading skills. Since no control group 
was utilized, it is impossible to be certain that these effects 
are directly attributable to the Program. However, it is reason- 
able to assume that the gains are attributable to R2R since 
these adults are not participating in any other major educational 
effort and their skills upon entering were marginal. 

A second issue which must be addressed is the meaningfulness 
of this gain in the context of the adults' entering skills. 
Specifically, an "average" adult entered with a score of 19.88 
and gained 6.16 in the course of the evaluation period, i.e., 
4-6 months, achieving an ending score of 2G.03. Thus the 
-typical" adult has moved from "illiteracy" co "marginal literacy" 
but is still substantially below the functional literacy level 
of 36 after this amount of training. This suggests that, while 
gain can be expected in short periods of time, the achievement 
of full functional literacy can be expected to take much longer, 
particularly for those with very low pre-test scores. 

Project Typology Gain 

Table 73 presents the analysis of residual gain based 
upon the three previously defined adult project typologies 
(Chapter IV) . While significant differences exist on a pre-test 
basis, no significant differences in residual gains were found 
among the three types. 
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Individual Project Gain 



As indicated in Table 74, there are significant differences 
among the 11 adult projects (based upon analysis of variance) . 
However, Scheffe contrasts indicated a difference of about 7.8 
was necessary for statistical significance, leading to the con- 
clusion that only projects R and U can be said to be superior to 
project P. 

As with the student projects, a descriptive analysis was 
undertaken to try to identify program features that are similar 
among effective projects. Table 75 presents this analysis. 
The findings of this analysis, however, were inconclusive and it 
does not appear that any of the individual program variables 
which we have identified is related to project effectiveness. 
Thus, it appears that project effectiveness is more a function of 
the overall administrative capability, quality of instruction, 
and staff, than of any identifiable individual program features. 

Termination Rates 

Table 76 presents the overall termination rate and rank 
order of rates on a project basis. The overall mean termination 
rate of 30. 9% compares favorably to Fimilar literacy programs though 
it is higher than the student projects . 

On an individual project basis, the rates vary substantially 
from a low of 0% to a high of 78%. These two extremes, however, 
should not be considered representative since the low project 
serves an Indian reservation (a group with almost no mobility) 
and the high project had to totally reorganize its volunteer 
tutoring component. 

In comparing the project variables to the termination 
rates, the following was found i First, the projects that had 
high termination rates generally seem to be more effective in 
terms of achieving gain among the non-terminees. This suggests 
that projects with high termination rates tend to be losing 
those students who are more difficult to teach. Second, some 
of the classroom and some of the tutoring projects (both volun- 
teer and paid) were capable of achieving better than average 
termination rates, suggesting that the form of instruction is 
not crucial to retention. This is supported by the project 
typology termination rates (Table 77) where the rates were 
reasonably similar, i.e.. Type I (25.3%), Type II (29.9%), and 
Type III (32.2%) . 
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Reasons for Termination & 



Reading Skills of Terroinees 



Table 78 presents the frequency of reasons for termination. 
Overall, more students voluntarily withdraw (21.4%) than ar e 
dropped by the projects (9. 7%T The primary reasons for with- 
drawal include: moved C52%) , unknown and other (7.8%). The 
primary reason for being dropped is non-attendance (8.1%). 

In comparing the initial reading skills of terminees (20.71) 
vs. oontinuees and completers (20.27), we found no significant 
difference (Table 79) . Thus we can conclude that termination 
is not related to any variation toased upon initial skill . 

Gain by Student Characteristics 

Tables 80 through 90 present the residual gain scores for 
the participants in the adult model based upon the previously 
defined' student characteristics. The following is a discussion 
of these gains and pre-test scores as they relate to differences 
among groups. 

§^ — No significam: differences exist either on the pre- 
test or residual gain. 

Ethnicity — Significant differences exist on a pre-test 
basis, but no differences were found on residual gains. 

Age & Grade Level — No significant differences in residual 
gain scores were found on the basis of age or grade level. On 
the pre-test score, however, people with more schooling scored 
higher than those with less schooling. 

Native Languacfe — No significant differences exist either 
on the pre-test or residual gain. 



Able to R ead Native Language (if not English) —Significant 
aifferences ex.\st b etween those who can read their native to ngue 
and those who cannot, with greater aair>g ht^inrf ^r^r^r^mpi ^ ^u^A Uy --l^g^,. 
adults who are literate in their native language. This suggests, 
that among adults, learning to read Egnlish is more easily 
accomplished if the individual is literate in his/her native 
language. 

. . Fluent in Spoken English (if native language is not English) - 
Significant differe nces exist, with those who are flu ent in spoken 
Englisn performing mo re effectiv'il^ Thus, similar to the above, 
the fluent group evidently can learn to read more rapidly than 
the non-fluent group. 
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Weeks of Enrollment — No significant differences were found 
on a pre-test and residual gain basis. 

Employment Status — Significant differences exist in residual 
gain. However, post-hoc analysis by Scheffe contrasts did not 
reveal clear interpretable results. 

Proportion of Attendance — The groups differed significantly 
on the pre-test with higher scorers tending to be more regular 
attenders. The groups did not differ significantly in terms of 
residual change scores. 

Reasons for Enrollment — Students who checked counselor 
suggested enrollment achieved less than those who did ndt check 
this item. No other differences were found. However, this 
suggests (as was the case with the student projects) that those who 
perceive their participation as voluntary do better than those whose 
participation is influenced by others. 

Attitude — The attitude scale was administered at two pro- 
jects (W & T) . The correlation between favorable attitude and 
residual gain was .09 (N=59) , which is not statistically signi- 
ficant (p;5^24). 

Hours of Instruction & Days Between Pre- & Post-Testing — 
Based upon the regression analysis, these variables were not 
significant in predicting gain. These findings may be interpreted 
similarly to the findings among the student projects. 



Staff Characteristics 

Tables 91-93 present the findings related to staff charac- 
teristics. On the basis of nuiober of years of schooling among 
staff members, significant differences were found in residual 
gain. No significant differences were found on the basis of 
the number of years of teaching or the number of reading courses 
taken . 
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Table 71 
PRE-TEST REAL SCORES 

Adult Projects ^ N Pre-Test 

" ' ' ■ - - f 



N 


23 


25.44 (11.32) 


0 


17 


14.35 (8.13) 


P 


50 


15.08 (9.88) 


Q 


14 


16.14 (8.87) 


R 


12 


26.25 (10.70) 


S 


13 


34.39 (10.10) 


T 


24 


26.63 (12.04) 


U 


19 


23.42 (12.42) 


V 


72 


18.22 (12.12) 


W 


37 


16.22 (10.80) 


X 


41 


20.34 (11.51) 



i 



Table 72 

REAL GAIN SCORES 
FOR ALL ADULT PROJECTS 



^ N Pre-Test Gain_ 

322 19.88 (11.98) 6.15 (9.54) 
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Table 73 

RANK ORDER OF ADULT PROJECT 
TYPOLOGY GAIN SCORES 



eisi COW Kv^^-- ^ 



Type 


N 


Pre-Test 


Gain 


Residual Gain 


I 


116 


18.31 (10.92) 


6.33 (8.58) 


-.33 (8.29) 


XT 


fi A 
O H 


4^,oi (12.03} 


4.79 (5.95) 


-.44 (6.05) : 


III 

s 

t 


122 


19.34 (12.61) 


6.91 (12.05) 


3.58 (10.52) 1 






F (2,319) - 

3.74 
p < .05 




P (2.319) = 
.46 

NS 



Adult 
Projects 



N 



Table 74 

RANK ORDER OF INDIVIDUAL 
PROJECT REAL GAIN SCORES 



Pre-Test 



Gain 



Residual Gain 



R 


12 


26.25 


(10.70) 


8.42 


(9.23) 


4.27 


(6.66) 


0 


19 


23.42 


(12.42) 


9.16 


(5.65) 


4.12 


(4.77) 


0 


17 


14.35 


(8.13) 


11.12 


(10.70) 


3.21 


(9.67) 


N 


23 


25.44 


(11.32) 


6.13 


(9.30) 


1.73 


(9.84) 


Q 


14 


16.14 


(8.87) 


8.93 


(7.56) 


1.58 


(6.32) 


W 


37 


16.22 


(10.80) 


8.60 


(13.17) 


1.27 


(11.66) 


V 


72 


18.22 


(12.12) 


7.18 


(11.77) 


.49 


(10.45) 


T 


24 


26.63 


(12.04) 


4.38 


(4.90) 


.35 


(5.24) 


S 


13 


34.39 


(10.10) 


.62 


(8.44) 


-.96 


(8.59) 


X 


41 


20.34 


(11.51) 


3.00 


(5.72) 


-3.02 


(5.82) 


P 


50 


15.08 


(9.88) 


3.56 


(6.60) 


-4.12 


(6.30) 



F(10,311) 

6.38 
p .05 



F(10,311) 

2.95 
p < .05 



150 



BEST COPY /VVAiu^ult 



in 




4j 



ERIC 



151 



Table 76 



RANK ORDER OF ADULT PROJECT TERMINATION RATES 

Rank Order of 



Adult Projects 


Termination Rate % 


Residual Gain 


Q 


0 


5 


» 


23.3 


XI 


W 


23.5 


6 


s 


23.9 


9 


X 


24.3 


10 


V 


26.0 


7 


T 


28.3 


8 


N 


34.3 


4 


U 


38.7 


2 


0 


39.7 


3 


R 


77.9 


1 


^OPOLATION MEAN 


30.9 % 





Table 77 

RANK ORDER ADULT PROJECT TYPOLOGY 
TERMINATION RATES _!/ 



Type 


Termination Rate % 


RanX Order 
REAL Residual 


of 

Gain 


I 


25.3 


2 




II 


29.9 


3 




III 


32.2 


1 





-T-^ Project "R" is included xn Type iil tor this «malysis since all 
of their teminftes caste frcw the tutoring component. 
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BEST COPY mmiE 



BEST copy mm\£ 
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Table 79 BEST COPY AVAllASlI 



COMPARISON OP REAL PRE-TEST SCORES 
BETWEEN TERMINEES & CONTINUEES 



Terminees 


Continuees i 


N 


Pre-Test 


N 


Pre-Test 


192 


20.71 (12.3) 


534 


* 

20.27 (12.4) 


F(l,724) 
= .78 

NS 



SEX 



Male 
Pemale 



N 

122 
163 



Table 80 
REAL GAIN BY SEX 

Pre-Test 



Gain 



21.54 (11.00) 5.18 (8.57) 
18.54 (18.96) 6.87 (10.09) 



P (1,283) = 
3.21 

NS 



Residual 
Gain 



.46 (8.88) 
.42 (9.06) 



P (1,283) 
.75 

NS 



Table 81 



REAL GAIN BY ETHNICITY 



ETHNICITY 


N 


Pre-Test 


Gain 


Residual Gain 


Black 


96 


18.54 (12.01) 


7.30 


(11.79) 


.88 (10.23 


White 


75 


23.68 (12.32) 


5.49 


(7.79) 


.65 (8.00) 


Spanish 
Surnamed 


98 


19.57 (11.24) 


4.70 


(6.89) 


-1.40 (6.62) 


American 
Indian 


12 


16.83 (9.20) 


6.75 


(4.98) 


-.19 (3.80) 


Other 


7 


12.71 (10.66) 


7.57 


(10.49) 


-.63 (11.13) 






P (4,283) a 
2. 51 

P < .05 

1 


54 




. 

F (4,283) = 
1.30 

NS 



Age 



I- 



C 14 

x^<^ 17 

17< 21 

21 < 34 
34 <43 
43 < 64 
>6S 



N 



4 
13 

47 

73 

50 

57 

18 



Ta ble 82 
REAL GAIN BV AGE 

Pre-Tf>st Gain 



BEST COPY AVAIU3LE 



!<esidual 
Gain 



X J • b 


(8 . 


54) 


15. 


50 


ao. 


47) 


7.32 


a. 


87) 


22.1 


(10. 


421 


Q 

7 ft 


OR 






J • OX 


t Q 


ob; 




( 10 . 


63) 


3 . 


94 


(9. 


15) 


-1.96 


(8. 


62) 


22.8 


ill. 


81) 


4. 


b6 


(8. 


38) 


-.83 


(8. 


06) 


21.2 


(11. 


81) 


6. 


14 


l7. 


46) 


.39 


16. 


41) 


16.6 


(12. 


50) 


6. 


21 


(9. 


72) 


-1.07 


19. 


43) 


16.3 


(13. 


09) 


9. 


11 


(12. 


75; 


1.69(11. 


37) 


F(6,255) 
=2.07 












F(6,255) 
= 1.62 
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Table 83 

PEAL GAIN BY GRADE LEVEL COMPLETED 
N Pre-Test Gain 



Residual 
Gain 



0 


119 




16.96 


(10.50) 


-1.39 


(7.61; 


1 


3 


6.67 i6.43) 


9.00 


(12.12) 


-1.20 


(10.99) 


2 


5 


20.80 (8.93) 


9.80 


(14.99) 


4.07 


(12.67) 


3 


9 


12.44 (11.39) 


10.22 


(13.09) 


1.94 


(12.60) 


4 


13 


13.39 (9.17; 


9.31 


(1 .60) 


1.31 


(12.44) 


5 


6 


11.83(13.99) 


7.50 


(10.31) 


-.97 


(9.30) 


6 


21 


17.14(11.20) 


6.43 


(14.92) 


-.42 


(13.36) 


7 


18 


22.78 (13.55) 


3.72 


(6.59) 


-1.40 


(7.60) 


8 


24 


22.67(13.37) 


5.50 


(10.23) 


.34 


(8.31) 


9 


26 


25.92 (12.56) 


8.19 


(9.09) 


4.03 


(7.32) 


10 


23 


25.91(10.85) 


3.91 


(7.70) 


-.25 


(7.63) 


11 


13 


27.39(11.39) 


8.15 


v7.60) 


4.44 


l5.76) 


12 


20 


27.00 (8.08) 


3.75 


(7.99) 


-.08 


(7.21) 



F(11.290) 

=4.24 
p < .05 



F(11,29U) 

=1.02 
NS 
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Tabl e 84 
REAL GAIN BY NATIVE LANGUAGE 

Residual 

Native Language N Pre-Test Gain Gain 



English 171 20.75 (12.31) 6.51 (10.54) .77 (9.61) 

Spanish 103 19.18 (11.36) 4.81 (6.74) -1.42 (6.61) 

Indian" 16. (9.20) 6.75 (4.98) -.19 ( 3.80) 



F (2,290) « F (2 ,290) - 

1.74 1.31 
NS NS 



Table 85 

REAL GAIN BY ABILITY TO READ 
NATIVE LANGUAGE (IF NOT ENGLISH) 



Residual 



Able to Read 


N 


Pre-Test 


Gain 


Gain 




Yes 


79 


18.54 (11.41) 


5.18 (6.82) 


-1.33 (6.67) 


No 


34 


18.79 (11.48) 


5.21 (7.52) 


-1.14 (7.49) 






F (1,111) - 
1.02 




F (1,111) « 
1.88 



p < .05 

NS 



Table 86 

REAL GAIN BY FLUENCY IN SPOKEN ENGLISH 
(IF NATIVE LANGUAGE IS NOT ENGLISH) 



Residual 

Fluent in English N Pre-Test Gain Gain 



Yes 


28 


26. 


.46 


(11.15) 


5.36 


(7. 


.94) 


1.36 


(7 


.18) 


No 


95 


15. 


,85 


(9.93) 


5.11 


(6. 


.48) 


-2.14 


(6 


.43) 



P (1,121) « F (1,121) « 

23.34 6.06 
P < .05 p<.05 
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Table 87 

REAL GAIN BY WEEKS OF ENROLLMENT 
# Weeks Enrolled N Pre-Test Gain ^^Gain^"^ 



4. 4 


1 


16.00 


(0) 




0 


(0) 


-7.39 


(0) 


4-8 


1 


6.1 0 


(0) 


12. 


00 


(0) 


1.45 


(0) 


9-12 


9 


26.11 


(10.75) 


5. 


78 


(8.32) 


1.59 


(7.37) 


12-16 


7 


20.71 


(13.56) 


3. 


00 


(8.32) 


-2.90 


(6. 50) 


16-24 


21 


20.48 


(11.85) 


5. 


38 


(4.25; 


-.59 


(4.60) 


24-32 


70 


19.11 


(11.60) 


6. 


32 


(8.91) 


-.22 


(8.43) 


32-40 


81 


18.26 


ai.21) 


5. 


39 


(9.05) 


-1.42 


(8.47) 


40-52 


15 


26.27 


(10.45; 


2. 


94 


(8.74) 


-1.64 


(8.99) 


> 52 


71 


22.20 


(11.94) 


6. 


42(10.12) 


.99 


(9.24) 



F(8,267) F(8.267J 
=1-64 =.68 



Table 88 



REAL GAIN BY PROPORTION OF TIMES ATTENDED 
Proportion Attended n Pre-Test Gain 



Residual 
Gain 



.9 ^1.00 


57 


25.61 


(12.05) 


4.49 


(8.33) 


.14 


(8.11) 


.8 < .9 


56 


20.32 


(12.00) 


7.34 


(9.32) 


1.32 


(7.97) 


.6 < .8 


95 


19.00 


(12.25) 


6.67 


(9.94) 


.23 


(9.20) 


.0 < .6 


106 


17.29 


(10.71) 


5.86 


(9.24) 


-1.12 


(8.61) 



P(3,310) 

=6.53 
p<: .05 



F(3,310) 
=1.06 

NS 
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Table 90 



REAL GAIN BY EMPLOYMENT STATUS 



Status 



N 



Pre-Test 



Gain 



Residual 
Gain 



> 20 nours 


148 


20.45 


(11. 


79) 


5. 


18 


(8.09) 




65 


(7. 


89) 


<20 hours 


20 


18.85 


(13. 


14) 


2. 


40 


(14.10) 


-3. 


92 


(12. 


71) 


Unen^loyed 


107 


20.49 


(12. 


07) 


7. 


31 


(9.25) 


1. 


49 


(8. 


08) 


Full-time 




21.00 


(4. 


24) 
















student 


2 


14. 


50 


(6.36) 


8. 


83 


(5. 


07) 



F (3,273) = 
.11 

NS 



F (3.273) 

3.62 
p < .05 



Table 91 

REAL GAIN BY STAFF NUMBER OF 
YEARS OF SCHOOLING 



# Years 


N 


Pre-Test 






Gain 


Residual 
Gain 


i 12 


66 


25.06 (12.06) 


6. 


05 


C8.26) 


1.3/ (7.95) 


13< 14 


23 


20.13 (12.11) 


8. 


61 


(9.70) 


1.87 (8.24) 


15£ 16 


105 


17.43 (12.66) 


7. 


64 


(11.54) 


.98 (9.85) 


>16 


74 


18.04 (11.03) 


4. 


39 


(5.18) 


-2.40 (6.29) 



F(3,264) 
-12.87 
p< .05 



F{3,264) 
='3.40 
.05 
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Table 92 



REAL GAIN BY STAFF NUMBER 
OF YEARS TEACHING EXPERIENCE 

Residual 

# Years N Pre-Test Gain Gain 

6 1 66 24.14 (12.25) 5.70 (8.04) .62 (7.29) 

2^5 0 

6^10 44 18.74 (13.24) 8.14(11.55) 1.25110.68) 

'''lO 139 17.83 (11.82) 5.38 (8.90) -1.30 (7.91) 



F(2,248) « F(2,248) 
14.30 2.17 

P4: .05 NS 



Table 93 

REAL GAIN BY STAFF NUMBER OF 
READING COURSES TAKEN 

Residual 

# Courses N Pre-Test Gain Gain 



0 
1-2 
3-4 

>4 



190 


18.76 


(12.55) 


5.88 


(9.82) 


• 


57 


(8.78) 


26 


24.77 


(10.89) 


4.00 


(6.50) 


-1. 


08 


(6.15) 


3 


26.00 


(2.00) 


7.00 


(7.21) 


2. 


77 


(6.79) 


1 


31.00 


CO) 


6.00 


(0) 


3. 


36 


(0) 



F(3,216) « 4.79 F{3,214) = .26 

NS 
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EVALUATION INSTRUCTIONS MANUAL ^CDpy . 
R2R CoMfiUNiTY Based Projects 



I. INTRODUCTION 

During FY 74, Pacific T. & T. A. will be conducting an 
evaluation study of 24 randomly-selected community based 
R2R projects. Your project has been selected for inclusion 
in the study sample. 

The purpose of the evaluation is to measure the project's 
effectiveness in achieving R2R program objectives and to 
identify the factors which contribute to successful outcomes. 

The primary objective of the national R2R program is 
improvement in reading performance. For this reason, we are 
placing primary emphasis on securing pre- and post- reading, 
test scores for every program participant , in order to measure 
the extent of reading improvement over time. Pacific T. & 
T. A. has undertaken an extensive research effort to locate the 
very best reciJing tests for this purpose and all sampled 
projects will be utilizing one of the two designated reading 
tests, for evaluation purposes, as follows; 

READING TESTS . ^ . , / 

(1) . For all projects primarily serving out-of-school adults, 
the test which has been selected is the R/EAL . This 

is a life-related test capable of yielding a score 
for persons with limited reading skills. 

(2) . For all projects primarily serving in-school populations, 
(i.e., junior and senior high school and college 

students) the SRA Multi-Level Achievement Series has" 
been designated. This is a relatively new school- 
type standardized test v;ith a .broad span of reading 
levels. 

The tcrtlnr^ rchcdu^G v.'ill allo'.; for a si:>:-r.onf:h cclonc'r.i- 
intorval between the .'pre- and poct-tofntr for f\ll those v;ho 
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BEST COPY AVAILABLE J^valuatiou Xnau«ctions wamuu 

in order to identify those factors which relate • 
«.ont in reading performance, we will ai ' 
info«,ation about student charLILL^ """^ 

sfaff characteristics iV f f ' attendance, 

lacteristics, and student attitudes. Four foi-m<, 
have been developed to secure th,-» 

secure thxs information, as follows: 

by'torfl"?"'""' '-^^^^^^^^^S^- to be completed 
by_ (or for) every proerar,, participant. This foL is 

being provided to the projects, pre-printed and pre- 
nu^berod, in triplicate sets, with carbon inserts! The 
original (white, copy is to be retained by the pr;jocr 
^oi your own records; ... c.,.„„ co ji" . 

CO be sent to PscifSc T x: t ^ 

" ^- open enrollment/ the 

scco«cJ carbon (yellou) Is to bo sent to Pacific ■ 

J. * T. A. upon tetmimtion. at which time the teriain- 
t on portion of the for.,, is to be completed. 

con,plctea monthly, covering sessions and h;;;rs attondo.. 
oL 1 r ^.^BilAlolmtoo^^t^^,^, to be 

LtL al ' ^".inist-;;:;ors, tcachei,, 

tutois and secretaries, full-time and part-time, paid 
and volunteer. This foa.-m is being provided, liL the 
Student oata Perm, pre-printed and pre-n^blred, i. 

(White, .opy IS to be retained by the project, for yo„; 
o\<n rocordsf the first e^rh^„ ,u, , ^ 

(yollo^O copy to he aent to P.cJfj, ^. , ^. 
t«r»i,„ti„„, at which ti„,e the termination portion of 
the fosn iu to ho ..plctod. Po^-tion of 
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(4). A ono-pacio /vttitiudc Sc{;Io , to moasure attitudcj toward 
reading, has been developed by Pacific T. & T. A. for use 
v.lth student and adult populations. *VhUi tcct v;ill be # 
administered only once, during the post-reading test period 
in May- June 1974. 

THIS MANUAL DETAILS THE PROCEDURES FOR EACH OF THE THREE 
DATA FORI'IS- THE ' STUDENT DATA FORM, THE STUDIDNT ATTENDANCE DATA 
FOm, AND THE STAFF/VOLUNTEER DATA FORM, SpC-.;ific instructions 
for administering the reading an"? attitude tests v;ill be provided 
separately. Timetables for administering these tests are, 
however, also included in this manual. Instructions pertaining 
to the data forms, contained in this manual, include: v;ho 
should complete each form, v;hen they should be completed, how 
they should be completed, and v;hen they should be returned to 
Pacific T. & T. A. 

When all procedures have been implemented, the complete 
file on every cnrollee v:ill consist of: 
o a Reading pre-test score 
o a completed Student Data Form 
o monthly Attendance Data 
o a Reading post-test score 
o an Jittitude Scale score, 
plus, for terminees, a statement of the date and reasons for 
termination , recorded on the Student Data Form. 

The complete iile on each staff member will be comprised 
of a completed St.if f/Volu::teer Data Form; plus, for termineer., 
a statciiient of the date and reasons for termination, recorded 
on the bottom section of the Staff /Volunteer Data Form. 

In addition to the provision and collection of forms, 
!>acific T. & T. A. staff will visit you on-site three times 
in the course of the study. During these visits, we will 
assist ou vjxtli testing and fOj.-. corrplet.'ion and observe your 
program in action. You are invito, to call us, collect, 
whenever you have any questions ab.mt, *-hc evaluation proccduvfr. 
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BEST GOPi AVAiUOLE 

II. EVALUATION SCHEDULE 1 

Pacific T. & T, A, will be collecting the data identificci 
during the period between November 2G, 1973 and Juno 30, 1974. 
The follov/ing v;ill explain the overall data collection schedule 
for thin period: , 

(1) November 26 througli December 14 

During this period, a Pacific T. T. A. staff 
ntembcr v;ill be at your project for one v;eek to 
provide you with reading test materials and to help 
you administer them to all students enrolled at the time. 
At the end of this week. Pacific T. & T. A. will 
collect all reading test boolclets, or answer sheets, 
for scoring and computer processing. 
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(2) DecemlXiX- and Janunry 

(a) Beginning December 1, you should maintain 
attendance records on all cnrollecs, covering the 
number of ser,r.ions attended, the number of sessions 
absent, and the number of hours attended, using your 
ovm form and system. 



(b) Toward the end of January, Pacific T. & 

T. A. will mail you. 

o Student Data Forms for all enrollees 
o Staff /Volunteer Data Forms for all staff 
members 

o A Student Attendance Data Form, covering 
December and January 

(c) Betv;ecn receipt of the packet and the last 
day of the month/ you should: 

o Have every staff member complete a Staff/ 

Volunteer Data Form, 
o Complete a Student Data Form for ever y 

program participant 
o Record attendance information (for December and 

January) on the student Attendance Data Form 

(d) Administer reading tests to all fstudcntfJ t'^ho 
wore not tasted during the s^chedulcd testing dates-^d.v.o 
to absence or late enrollment. (It is suggested that 
testing be done in groups, v.'here this is compatible with 
your program design, in order to reduce the staff burden 
in connection with testing, so long as testing can be 
completed within the month.) January 25 has been estab- 
lished- the target date for completing £ij± initial reading 
tests. 
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(3) February ^^^^^ . BEST COPY AVAMBli 

(a) Prior to tho 5th day of tho nionlh, mail to 
£iiHiL^SJ£i_JLI:^. the forms completed during the 
preceding month, including; 

o BluG copies cf the Staff/volunteer Data Forms 

for all staff employed currently 
o Blue copies of the Student. Data Forms for 

all enx-ollocs* 
o Heading test booklets (n/EAL) , or answer 

sheets (SRA) , for all enrollees tested after 
. the designated testing dates 
o Completed Attendance Data Forms for December 

and January 



*Note : 

For students vho wero enrolled on December 1, but 
ternunatoa prior to receipt of the Data Forms, fill 
i foL"'"-^ information as you can-^-including terminaticn 
copi^c- ^^"^ "•'^ ^^'^^ the blue and ?ellow 
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BEST GOPl AVAllABLE ^^^^^^^ 

(4) March 

(a) Prior to the 5th day of the month, mail to 
Pacific T. & T. A. the forms completed during^ the 
pJ^eccding month, including: 

o Blue copies of the Staff /Volunteer Data Form 
for ncv; staff members, beginning employment 
during February , 

o ' Yellow copies of the Staff/Volunteer Data Form 
for all staff members terminating in February 
(with termination portion filled out) 

o Blue copies of the Student Data Form for 

enrollees entering the program in February 

o Yellov; copies of the Student Data Form for 
enrollees leaving the program in February 
(with termination portion filled out) 

o Reading test booklets (R/EAL, or ansv/er 

sheets (SRA) , for all enrollees tested durina 
February (i.e., February enrollees and 
termineos) 

o Student Attendance Data form for February 
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(5) April MST COWJVVJUIABLE BEST COPY MLABLE 

Kcpeat process as shown for March. 

(6) Majr 

admxnxster pro-roading tests to new enrolloos. 

(7) May-June 

During this period, a Pacific T. s T A staff 

-..r ,,in at .our project for one we ,c L t you 
to aa , ^^^^ ^^^^ ^^^^ .ou 

tos\i' ^^"^-ts. specific 

At the end : T '^"'"'^'^ " consultation with you. 
At the end of this week, Pacific T. & t a win . i 

aU reading and attitude test h,. , ! 

for scorl J ^ ^ """'-^ test booklets and answer sheets 
tor scoring and cor.-.putor processing 



The following two schedules are provided for your 
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Evaluation InisUuctioni; X-Unual 



STAFF/VOLUllTEER DATA FOHM Bmmmmu: 

This is a basic Gmployment j;om for all staff members " 
(including volunteers) . It consists of a triplicate 
set of forms with carbon inserts? The original copy 
(white) is for your office files; the first carbon 
(blue) is to be sent to Pacific T. & T. A >? and the 
second carbon (yellow) is to be sent to Pacific T. & 
T. A. v.'hen a staff member terminates. The form has 
three basic sections: Part I — the box at the top includes 
information required by Pacific T. & T, A. for record- 
keeping and computer processing (it will come to you 
pre-printed) ? Part II— the body of the form covers all 
basic relevant information about the staff member; and 
Part III — termination data (to be completed only upon 
termination) . 

The Staff/Volunteer Data Form should be completed for 
each staff wciiiber employed — administi-ative, instructional, 
and clerical; part time and full time — and all volunteers. 
When you first receive the forms in January , complete 
a form for each staff member currently employed, and for 
each volunteer currently participating. Thereafter, 
complete a form for each new staff member and volunteer,* 
betv:een "February 1 and May 31. 

The forms should be completed by each staf f /volunteer . 
All forms should be checked by a designated staff member 
for completeness and accuracy. 

The form should be completed upon receipt of the forms fvoin 
Pacific T. t T. A. in January. 7vll blue copies are to ba 
mailed to Pacific T. & T. A. prior to February 5. Thereafter, 
the form should bo completed for each new staff momber at the 

tii.io of initir.l c.inployjr.rnt cMjd/o?: volunLoc-r r.ifjn-up. 

V.'hen a atiiTJ r.:: v.-.b:<r or volunteer tcrninctcn, an apj?ro})r ( 
Rtaff no^!>er nhoul'.l ccr-^plctc < ?)o tcrniinatioi) infoiTititio^ 



at the bottom of the page. 



BEST COPY mum 



Note: 

If any forms are still outstanding at the time the 
initial packet is returned to Pacific T. & T. A. , 
prior to February 5, they should be sent to us as 
soon thorecifter as possible. The object is to 
insure that our Data Bank contains full information 
on every staff member. 



13 



t 

HOW? ^^^^ ^" questionnaire 

has: a number. The folloving 
exx)lains bow to complete each 
item. 

Part X 

tfhc name of your agency will be pire- 
printcci; check to £:oe that it is correct. 
The project id nunber has already been 
assigned. This nuirJjcr will remain the 
same on all forms and will be used for 
computer control. 

Each Staff A^oluntcor Data Form has an 
individual prc-assioned ID nx:m;bor. The 
numbers arc arranged sequentially. Only 
one fonn and number should be uaed for 
each staff /volunteer. After the ID 
number is cts^^■5.cJnod , it v;ill bc^ ucod to 
identify that staff uia^iber throughout 
the evaluation proccjis. If a fonn is 
not used or completed incorrectly, 
print VOID across the form and mail 
it, along with the correct forms, to 
pacific T. & T. A. 



J^valuation InstrucLioni: Mammal 



11. VJrito Sn date of actual cniploywrnt 
or volunUiry asfiociation with project, 
using monthf day and ycari e.g., 

UTol fell 3! bill . 



12. Write in the planned number of total 
hour s scheduled per week,- e.g., [oT^i or 
(2T0I. 



13. For instructional staff and volunteer 
tutors, write in the planned number of 

"teaching hours? e.g., EE • "p"" , . 
instructional staff, write in ;sero, |0| Oj . 

14. Check the language in which the staff 
racmbcr/voluhteer first learned to speak. 

15. Self -explanatory. Fluency implies • 
the ability to communicate (specik and 
understand) with ease . 

Part III 

16. Upon termination, write iii thc^^ 
of termination; e.g., gjj) G3 • 

17. Check "dismissed" or "voluntarily 
left" and ajjpropriate sub-categories. 



Part II 

1. Print the staff/volunteer* s complete 
ncune. 

2. oelf -explanatory. 

3. VIrite in birthdrvte, shov;ing_mpntI^, day 
and year; e.g., 0|1 (pil 

4. Self-explanatory. 

5. Write in the highest grade completed at 
time of C:^itploiT;ent/pr,rticioation; e.g., 
four years of college, jlKj • 

6. Check the liighcst degree received. 

7. self-explanatory. 

8. Write in number of years of teaching 
experience at tiinc of er-u^loS-mcnt; e.g., 
[oTel . If no years exi?erienco, write in 
zero, 00) . 

9. Write in the nu^aber of years of other 
experience which you feel will help you 
do a bettor job in U2rvf e.g., working v;ith 
adults in /iFK program, wor):ing in neigh- 
bor hood Youtli Corj.r., etc. 

10. Check all r-iiropr jat.o bc^nc.--';. 



BEST COPY AVRIIABU 
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STUDEilT DATA FOm BEST COPY AVAIUBIE 

WHAT? ^ basic enrollment form for all program 

participants. It consists of a triplicate set of 
forms with carbon inserts: The original copy (white) 

: Is for your office files; the first' carbon (blue) is 
to be sent to Pacific & T, A .? and the second 
carbon (yellow) is to be sent to Pacific T. & T. A. 

* when a student terminates. The form has fouj* basic 
sections: Part I— the boic at the top includes informa- 
tion required by Pacific T. & T. A. for record-keeping 
and computer processing (it will come to you pre-prihted) ? 
Parts II and III— the body of the form covers basic 
information about the student and is divided on the basis 
of who is to complete it (both of these parts are to be 
completed upon enrollment); Part IV— termination data 
(to be completed only upon termination) • 

FOR WHOH? The Student Data Form should be completed for each student 
who was enrolled in your program as of Deceiaber 1, 1973. 
l^hen you first receive the forms in January, complete a 
form for each student enrolled between December 1, 1973 and 
'January 31, 1974. Thereafter, complete a form for each new 
student who enrolls, between February 1 and May 31. 

BY WHOM? ^^^^ ^^^^ ^® completed by the students 

themselves. If the student cannot complete this section, 
it should be completed by a staff member on the basis of an 
oral interview. 

Part III is .to be completed by the teacher, tutor or other 
staff member. All forms should bo checked by a designated 
staff tviember to be sure each item is filled out completely 
and accurately. 



WHEK'? 



o 
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The form should be completed upon receipt of the packet 
fron Pacific T. & T. A. Por students enrolling aCior 
February 1, the form should be coiaplcl.ed at the tirao ei: 
enrollr.K.nt or within n few days after enrollment. 

15 /i3 



When a student tcrminatcssr a staff member should 
complGte the termination information at the bottom 
of the page. 



Kote : 

If any forms are still outstanding at the time the 
initial pac);ot is returned to Pacific T. & T. A., 
prior to February 5, they should be sent to us as 
soon thereafter as possible. The object is to insure 
that our Dato Ban?: contains full information on 
every cnrollee. 
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** HOW? Each itcia on the qucstionnaiirc 
* has a number. Tho lollov;in«j 

explains how to compXcto each 
item. 

Part X 

The nano of your agency will be pre- 
printed; check to sec that it is correct. 
T^c project ID nunibcr has already been 
assigned. This number will remain the 
SAne on all forms and v/ill be used for 
coc^putcr control. 

Each Student Data Pom also lias an 
individual pre-assigned ID number. Tlie 
nurabers arc arranged sequentially. 
I^umbers have boon assigned to all 
students included on your initial 
roster; onco a number has been assigned^ 
it must alv:£ryR be used to identify that 
student. If a pre-numbercd form is 
(spoiled r replace it with 
a blank form, copying the student ID # 
as shown on the pre-nunibered form. 

Part II 

1. Tho nantes of students appearing on 
your x^oster have been i^re-printed. For 
all others, print the student's complete 
name. Use the sanie nai?.e on any other f OT.*ras 
utilized* Nutaen are required for control 
purposes and to facilitate ca;iinunic«4tion 
Jbetiv^cen your project and Pacific T# & 
T» A* about missing data. 

2^ Self-explanatory. 

3* Print the student's bir thdate^ showi^^ 
»onthi day and year? e.g., (ofs) [gT?! 01 
for. March 27, 1946^ 

4* Self-explanatory. 4 

5* Write in the highest gr.dc completed 
at the tine of enrollraont; e.g., 7th 
9rader (o]?] , one year of college, \L\3\ . 

6* Chock the appropriate box. If full 
tiimo student is checked, do not check 
unemployed. 

?• Chock tlio approx>riiite boK(es). If the 
student va« net directly referred by an 
iiK^ividual or agency, do not check t bo- 
first bOK. If a referral was made, other 

bc:;er> which r.ro apprrpri^ito nay vJr.o ho 
checked • 



Tart III 

B. Write in month, day and ycrar of 
ciurolljnenty e.g., 01) 03 Hll • 

9. Check tlio language in which tho ^ 
student first learned to speak. 

10. If the student's prijuary language 
is not Englishi indicate whether the 
student is literate in his primary 
language. 

11. C))eck whether or not the student can 
speak ISnglish fluently at the time of 
enrollment. 

12. Check the appropriate box. Class 
is defined as group instruction; tutor 

is defined as one-to-one tutoring f.essions 
and does not include tutor ing/inclividualiscd 
instruction in a classroom structure. If 
A student is receiving both types, chc:cJ; 
both boxes. 

13. Print the name of the student's teacher 
& or tutor and their ID nujnber (soo 

14. Staff Data Form instructionr) . If a 
student has more than one toachcir or 

tutor, print the name of the teacho^/tutcr 
who spends^ the most time with tho ^tuuent. 
If more than one teacher is in the cIr:>:r.roc:.^. 
at the stmie tiire, print the name of t5/e 
supervising teacher- 

15. Print the number of sessions? i.e., 
classes or tutoring sessions, the sbuclcnt 
is expected to atten d ea ch week? e.g. , 



4 classes per week, 0}^^ . * If tho nurber 



of classes varies each week, write in the 
average. 

16. Print the number of scheduled hours? 
e.g., 4 classes per week at 1 hour per 
class would be i6T4] . If the number oi 
hours vorios, write in the average. 

Part IV 

17. Ux>n termination, v;rite in the date 
the student terminated, as in Items 3 s C. 

IG. Chock one colximn as follov/s: 
•*VJithdrev;*' should be chcc3;ed when a studont 
,dr'Oi>s out? "nropped" should be c}v:ic};c?d if 
the project terninatos the student v»riox- 
to completion; ''Completed" should b^i c):r!ckcd 
if the project/student has determined tli^t 
tho niudcnt h^ir, r.uccci^sfuj )y ccr.Mjh.t ' c1 
}^):otir:*iA. lloKt, vhrch Diu aju^J o^r c t- '. '" 
cr^tocjorico u:>Jcr tho coIimuU. 
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ATTEIJDAIICE DATA FORM BEST COPY AVAILABU 

WHAT? Attendance Data Form is a vehicle for compiling 

attendance data on all enrollees, for a period of 
one month. 

It is assumed that each project has its own system for 
recording enrollce attendance information on an 
on-going basis, probably in the form of teacher "roll" 
sheets. Wiile continuation of existing systems is 
completely satisfactory, it is essential that such 
systems be re-examined and, if necessary, expanded, to 
include the required information; i.e., number of sessions 
attended, number of sessions absent, and number of hours 
attended. VJhen the roll-taking system has been revised 
to include this data, the task will simply be to gather 
and compile the attendance data on the form provided. 
Agejicy, plus student names and ID numbers will be pre- 
printed by Pacific T. & T. 7\. ; completing the initial form 
will entail entering teachers* names and ID*s and supplying 
attendance data for every enrol lee— for December and Janviery. 
Thereafter, it will only be necessary to note any changes in 
teacher assignments, identify terminces and new enrollccs 
and supply attendance data for one month, 

FOR WHOM? All students enrolled in the project during any part of 
the month in question. This includes all on-going 
enrollces, all nev.* enrollces, and all torminees whose 
termination date falls within the month being reported. 

BY V^HOM? is suggerted that one staff member be designated to 

compl6to the form on a regular basis, so that he or she 
will be completely familiar with the form. 



The £;tuc!c^'t Attc?n:'!ru;cc Pnt:?. Forn r.hould bo completed r»1 

the end ol each uon'jh end i-cilt d to Pccilic T. £ T. />. 

(along v;ith all otltor materinlf*) prior to the 5tli day o£ 
the lollcv.'li.Mj h.oi/ih. / 

18 I^C 



tcnd^Mico u.aa form l-valuation InnltructJonrj tUmu,l 



HOW? !• The nawo pf your project will ai.>i>ear 

on tho formr choc); to sgo tiuit it 
is correct. 

2. Yhe Project ID has already been 
assigned and will api-^ear in tho 
op23roi>riate fri^acc. 

3. Tho names of tho correct reporting 
month (or months) will appear in 

. , 'the appropriate opace. 

4. We plan to provide you with a 
C print-out of student ID*s and 

5. names. Should this prove 
impossible during any given 
month, you will need to write in 
sequcntiyl order tho ID numbers of 
all students who are currently 
enrolled tliat month S print tlie 
appropriate name next to each ID. 
Homes of newly-enrolled students 
slK>uld be added to tlje list 
px'ovided, 

6. VJrite in the ID nuir.ber and name 

& of the studeint's _p}:5i.-ery instructor 

7. on the form to i^o suLr.titted in 
February. Thereafter, write in 
the ID and n.ime for the current 
month's instructor only if the 
instructor has chnn <?fd since the 
Preceding month. 

9 

B. VJrite in the actual nunO?er of ceusions 
9. attended, numbrr of sessions i;bscnt, 
fi ijnd total hours attended for each 
10. student that Month, from the first 
tlurough tho last day of the calendar 
month. Round off hours to the 
nearest amount (e.g., hours would 
be 7j Vi hours would be 7). If a 
student terminates anytir.e during 
the month, print the number of 
sessions and nujnber of hours attended 
(coluKUiS C and 10) prior to te»rmina- 
tion, and write 'mvAmim'D in column 
9 (sesH:ions absent) . 
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TEST INSTRUCTIONS 

SRA examiner's MANUAL 
REAL examiner's MANUAL 
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SRA EXAHINER'S HANUAL 

ADMINISTERING THE SRA READING 
ACHIEVEMENT SERIES 
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SRA EXAMINER'S MANUAL 

ADMINISTERING THE SRA READING ACHIEVEMENT SERIES 

ADMINISTERTNG THE TESTING PROGRAM 

This manual presents the standard procedures for administering the SRA 
Reading Achievement Series, Form E. Teachers who will administer the test should 
read the manual carefully to gain familiarity with the testing procedures and the 
methods of marking answers on the answer sheet. It is important that all 
directions be followed correctly since uniform conditions are necessary for 
accurate testing. 



MATERIALS NEEDED FOR TESTING 

Test Booklets - Each color coded booklet contains the tiQ reading battery 

areas— comprehensive and vocabulary— to be used. Students 
should be tested in these two areas. Each student taking 
the test will need a booklet. 

Each color code represents e different reading level. The 
booklets should be used as follows: 

students reading under 5th grade level BLUE 

students reading from 5th to 9th grade level — GREEN 
students reading above 9th grade level — — RED 

Make the color code assignment to each student based upon 
the best available information you have concerning the 
student's reading level. The booklets overlap In terms of 
difficulty so that assignment to the appropriate book is 
somewhat flexible. 

All students should be requested to take the test even if 
their reading ability is currently very low. This will 
enable each student to demonstrate progress over time. 

A separate answer sheet, with the same color as the test 
booklet, should be given to each student. 



Answer Sheets - 



Pencils & 

Erasers 



Each student should have a #2 pencil and an eraser. Extra 

i'Z pencil r sh-Jld bs avail all e. 



/ 
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TESTING COrtDITIONS 

Testing conditions should be as comfortable as possible for the students. 
The testing room should be quiet and well lighted, and each student should have a 
desk, if possible. 

SIZE OF GROUP 

If. you are administering the test to a large group, one teacher should be 
available for each 30 students. If the tests are to be given on an individual 
basis, each teacher or tutor administering the test shouM be completely familiar 
irith all procedures. 

TIMING THE TEST 

The reading comprehension and vocabulary series emphasize power rather than 
speed. On some occasions, all students may have finished before time limits are 
reached. If everyone has finished, you can end the period. The testing time Is 
as follows: 

testing time administration time 
reading comprehension 50 minutes 5 minutes 
reading vocabulary 10 minutes 2 minutes 

Make sure that the testing time for both sections is' controlled carefully. 
An interval timer, stopwatch or watch with second hand should be used. 

mPER MARKING OF THE ANSWER SHEETS 

Filling In Response Ovals: The answer sheets will be scored by an electronic 
scoring machine. The machine can score accurately only If the answer sheets are 
properly marked. The examiners and proctors must make sure that the sheets are 
marked correctly. The most Important considerations In filling in response ovals 
are listed below: 

1. Each mark must be dense and black; soft (#2) pencils must be use'd. 

2. Each mark must cover more than half the area of the oval. 

3. The mark must be made within the oval. Marks need not be uniform 
In size or shape. Very neat or fusSy marking should be discouraged, 
since it takes too much of the student's time and may lower his score. 

Tho exfir.ploc hcOov/ illustrate good and poor marking. 

too Urge too small 6 correct 0 

/ 
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If this 1$ the first time the students are using separate answer sheets* It 
te helpful to Illustrate proper marking on the chalkboard. 

Marking the Name Grid: Proper marking of the name grid (side 1 of the answer 
sheet) is necessary for correct listing of the students* names on the reports of 
test results. In filling in this Information each student must: 

U Leave a space In the box between last name and first name. If a 

student's name Is too long to fit in ths grid, he should be instructed 
to print only as much of it as space allows. 

2, Mark only oae oval in each alphabet column. 

3, Blacken the oval at the top of each coli^ containing a blank box, 
including all columns to the right of the name. 

4, Erase completely all Incorrect marks before blackening the proper oval. 

Entering Identifying Information: Before the first test session begins, it 
will be helpful to put on the chalkboard the identifying information exactly as 
students are to print it on the answer sheet. Only two items will be needed in 
addition to the student's n&me: 

1. On side 1, the student should print the name of your R2R project where 
the space is prov1d<?(* for the school name. 

2. On side 2, the exact date of test administration should be completed 
under the numeric research grid. The last two columns of Field B 
should be used for the month; the last two columns of Field C should 
be used for the days and the last two columns of Field D should be 
used for the last two digits of the year. An example follows: 



\m 

2>C 

DC: 

»c 
2>g: 
so: 
7>c. 
r>c. 

'OC 



I t $ 0 



fcESCACCH GRID 



LLLLLUJ 



•5:000 
:>ci>oc5 

•/.OOP 



Af c 



FloMD 



nr>oooo 
: 00 :000 
©0:000 
■••'Jjo.oocs 

• ''CCD 00 

.' ;COOOO 

: .r^cooe 

' :00 c 

• .''«i>»OOC 



I 

r 

i35< >. 



November 29, 1973 
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Remember only the student's name, name of ydur project and exact date 

of admlnUtration are needed. All other Information can bn left blsr'< 
The nan:e of the project and date should be posted on a chalkboard W 
possible. 



copy AVAILABLE 
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IMTRODUCTORY DIRECTIONS TO STUDENTS 

(Directions to the examiner are printed with no Indentation and should not be 

read to the students.) 

(Directions to the students are Indented In this manner and 
bordered by a vertical bar on the left. The Indented sections 
In quotation marks are quoted d< .tly from the test booklet! 
the students may read along slickly while the examiner reads 
these sections aloud.) 
The directions In this section will prepare the students for the tests and Instruct 
them In filling in the name grid and other Identifying Information. These 
Instructions are to be used only at the beginning of the first test session. 
Hake sure each students has two ^2 lead pencils and an eraser. Students may not 
use pens or colored pencils. The students should be seated in the desired 
arrangement and separated as much as possible. 

Read all directions slowly and distinctly. Say: 

Today we are going to begin taking a series of tests that will 
help you and your teachers know how well you can remsmber and 
use what you have learned. 

It is important that you do your best on these tests so that 
your scores will show clearly your educational strengths and 
weaknesses. 

The answer sheet that I will pass out in a moment will be read 
by a machine that will record your scores. These machines are 
very accurate, but it Is Important that you listen to and follow 
carefully the Instructions for making your marks so that the 
machine can read them. 

Do not make any marks on the test booklet. You are to mark your 
ansv/ers to the test questions on the separate answer sheet. 
I wfli now give each of you an answer sheet. Do not mark the 
answer sheet. Leave It on your desk until I tell you what to 
do with it. • 



Pass out the answer shocts. 
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Mien all tlie materfaU have been dtstrlbutedt say: 

Be careful how you handle the answer sheet. Do not fold It or bend 
the comers. Keep It as clean as possible. Hake no marks on It until 
I tell you to do so. 

Place your aftswer sheet on your desk so that side 1 faces up. 

Check to .see that all pupils have side 1. Show them "SIDE V printed on the 
answer sheet. 

I Above "school", print the name of our Right to Read project. 

Give the name of the project and pause. Allow enough time for all students to 

complete this Identifying Information clearly and accurately. Then say: 

Now look at the name grid at the bottom of your answer sheet. To 
find out how to put your name In the gr1d» read the section above 
the grid called "Marking Your Name" silently while I read It aloud. 
Kake no marks on the answer sheet until I tell you to do so. 

"Your answer sheet will be scored by a machine. This machine can 
also 'read' your name If It Is properly recorded on the answer sheet. 

"There are two steps In filling In your name. 

"First, print your name In the boxes below the grid like this: 
(1) last name*. (2) skip a bc/.^ (3) first name. If your whole 
name will not fit In the spsce, print as many letters as fit. 

"Second, fill in the matching oval above each letter and each blank 
box. Blacken the entire oval, but do not go outside it. 

1. Fin In the matching oval above each "better. 

2. Fin In the top oval above the blank box between the parts 
of your name. 

3. Fill In all the blank ovals above the blank boxes after your 



name." 



Remember—there are two steps to filling In your name grid: first, 
printing your name in the boxes; second, filling in the matching 
oval above each box. 

Are there any questions abcut filling in your n^r.e? 
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Pause to answer any questions about the name grid. Then say: 

I Now take your pencil and print your last name In the boxes at 
the bottom of the name grid. Put one letter In each box. 

Check to see that all students are printing their last names properly. Then 
continue.* 

I Now skip one box and print your first name. 

If a student's name Is too long to fit In the gr1d» Instruct him to print as 

much as possible. Then say: 

Now fin In the ovals above your name. Begin with the letter In 
the first box. Find the same letter In the alphabetical column 
directly over It. Make a heavy black mark Inside the oval 
showing this letter. Make your mark large enough to fill the 
ovaU but do not go outside the oval. 

Do the same for each letter of your name. 

Be sure to blacken the blank oval In the column above a blank 
box. 

If you make a mistake, erase very carefully and make the 
right mark. 

Allow enough time for students to fill In their names. Walk around the classroom 
and check to see that each student Is working carefully and accurately. 

When all students have finished filling In their name grids* Instruct them to 
turn to side 2 of their answer sheets. Say: 

Then to side 2 of your answer sheet and look at the right hand side 
of the sheet that says •'Numeric Research Grid". This section will 
be used to fill In today's date. Under the last two columns of 
Field B put In the number of this month, by filling In the correct 
ovals. Under the last two columns of Field C put In today's - 
date by filling In the correct ovals. Under the last two columns 
of Field 0 put In the last tv/o digits of the year by filling In 
the correct ovals. 

The correct date and ovals to be checked should be placed on the chalkboard so 
the students can fill this section out correctly. BEST COPY AVRIIABIE 
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Continue by saying: 

We are almost ready to besfin the first test. Read the section on 
your answer sheet called "Marking Your Answers" silently while I 
read It aloud. 

"Each row of ovals on the answer sheet has number that matches 
the number of one of the test questions. To answer a test 
question, decide which Is the best answer. Then find the row of 
ovals numbered the same as the question. Hake a heavy black 
mark In the oval with the same letter as the answer you have 
chosen. 

*There are three Important things to remember; 
"First, the heavy black mark you make should be large enough to 
fin the oval, but It should not go outside the oval. Do not 
waste time making extremely neat marks, but make sure the mark 
is heavy and fills the oval. 

too large * too small 9 correct B 

"Second, keep your place on the answer sheet. Make certain you 
make your mark In the row numbered the same as the question you 
are answering. 

"Third, mark only one oval In a row. If you change your mind 
about an answer, erase your first mark completely and make 
another mark." 

Do not fold or bend your answer sheet. Keep It as clean as 
possible. Mark only In the ovals provided, because extra marks 
might be counted as errors. 

Are there any questions? 
Answer any questions and then read tht Instructions for the first test. ^ 

DIRECTIONS FOR ADMINISTERING THE READING TEST 

Open your test booklet to page 3. Read the directions for the 
Reading test silently while I read them aloud. 
"This Is a test of how well you understand whSit you read. The 
test has stories for you to ro?.d and cuostions nhout th^ storlt^s 
for you to cnLv.:.r. Uced l acS Uovy; tl-..;n 5nv..ai' tho qucstictts 
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that follow it. Mark the space on your ahswer sheet that 

matches the letter of the answer you choose. Here Is an ^ ' 

example: 

"'Make a wish and blow out the candles!' That's something 
people have been saying to birthday children for hundreds of 
years. Long ago, people thought that candles had magic 
• powers. The candles on a birthday cake had the power of 

granting a wish. To get the wish the birthday child had to blow 
out all the candles at once and keep the wish a secret. Today, 
most people dot/t believe that candles have magic powers, but the 
custom goes on. 

51 To get his wish the birthday child had to 

A. eat a piece of cake 

B. keep the wish a secret 

C. say the right magic words 

0. find the special birthday candle" 

Choose the correct response and mark the space that matches Its 
letter for question SI in the Reading section on your answer sheet. 

Give the students time to complete this. Then say; 
"S2 In line 4, *dt once* means 

A. right away 

6. one by one 

C. at the right place 

0. at the same time" 
Choose the best response and mark the space that matches its 
letter for question S2. 
Give the students time to complete this. Then continue reading: 

"The best answer for question SI Is B. 'keep the wish a secret,-' 
so you should blacken space B for question SI in the Reading 
section of your answer sheet. The best answer for question S2 
Is D, *at the same time,' You should blacken space D for question 

52 In the Reading section of your answer sheet. 

"tocrbor io h1:c?'cn only r>.-<- space for each question. fvM.o ivv(> 
you Hiicktr Ir.i con-tt Sicc^? ^^oi' answer. You can look back 
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at the story when you are answering the questions • If you wtsh 
to change an answer » carefully erase your first answer and then 
blacken the space for your new answer. 

"When you are told to begin » work until time Is called or until 
you come to the words STOP HERE." 

Swne passages are harder than others. Try to do your best on all 
of them. If you finish before time Is called, you can go back and 
check your work. 

Are there any questions? 

Take time to answer any questions. Then say: 

I Begin. 



* 50 minutes 



starting time stopping time 

Allow exactly 50 minutes for this test. Then say: 
I Stop. Put down your pencil and close your booklet. 

DIRECTIONS FOR ADMINISTERING THE VOCABULARY TEST 
Check to see that each student has pencils and an eraser. Then say: 

Open your booklet to the Vocabulary test and read the directions 
silently while I read them aloud. 

"This Is a test of hovi well you know the meaning of words. For 
each question, choose the word that has most nearly the same 
meaning as the underlined word. Mark the space on your answer 
sheet that matches the letter of the meaning you choose. Here fs 
an examp.le: 
SI begin the game 

A. win 

B. watch BEST COPIT AWJUIBLE 

C. start 

D. ten-:- -ber" 

Pause wh'le the students choose the best response. Then continue reading: 

/ 
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"The best answer Is C, •start,* since It has most nearly the 
same meaning as begin. You should blacken space C for question 
SI In the Vocabulary section of your answer sheet. 

"Remember to blacken only one space for each question. Make 
sure you blacken the correct space for your answer. 
"When you are told to begin, work until time is called or until 
' you come to the words STOP HERE." 

If you finish before time Is called, you can go back and check 
your work. 

Are there any questions? 

Pause to answer any questions. Then say: 
I Begin. 



+ 10 minutes « 

starting time stopping time 

Walk around the room to make sure students are recording answers properly. 
Al^ow exactly 10 minutes for this test. Then say: 
I Stop. Put your pencil down and close your test booklet. 

This is the end of the test, and all booklets and answer sheets should be collected. 
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2 DESCRIPTION or a/CAt 

lo'lts present form, f{/t/\L consists o£ T 

I; Nine reading selections, each representing a more general category of reading often 
encountered by most individuals of high- school age or above. These Include: 

O A set of road signs 
_ - o A TV schedule 

o A set of directions for preparing cheese pizza 

o A reading selection on the topic of narcotic drugs 

o A food market ad 

o An apartment lease 

o A road map 

o A want ad 

o A job application 

A movie ad is used to illustrate the operation of the test. The selections, presented to the 
reader in printed form, are reproductions of originals. 

Z. Five questions for each selection, forty- five quesUons in all. These questions arc 
based on task analyses of tho functions required to deal with each selection. 

3. Individu-nlly operated cassette pla./ers and .earphones are used for the presentation 
of qucr.tlons to each individi-al, pemitting R/EAL to be self-administered, self-directed 
and self- paced by audio input. This method of presentation and administration was selected 
because it provided maximum motivation and more closely resembled the process an indiv- 
idual might face in dealing with the selections. The audio input also helps to insure tliat 
a student's inability to understand the questions presented in written form will not detract 
from hjs ability to understand what he Is expected to do. Many of the target population arc 
capable of understanding concepts aurally, whereas once the concepts are shrouded in 
written language, the message seems to them blurred. 

4. Self- pacing relaxes the student and insures a more accurate meas'ire of his ability. 
Self-admlnistjotlon removes the pressures often imposed by the presence of dn unfamiliar 
proctor (who may appear hostile). Sclf-dlrectlon permits tho student to assume respcns- 
ibility for his own performance on the test. 

5. Constructed responses to open-end questions are made oy the student directly into 
the test oooklet in the appropriate space. The procedure was selected because this format 
provided a more valid measure of the student's literacy and more nearly represented what 
would have to bo done in the actual reading situation . 

6. Scoring by hand Is done by referring to tho pre-established correct responses. (See 
Appendix A for Scoring Key and Appcndi>: B for Amplified Scoriny Key.) An individual's tot:il 
raw score and scores on each of the nine reading selections con be easily ascertained. 
Raw scores are then converted into percent of items pr.ssed. Mastery of functional litorucy 
is determined based on the definition of tho tasks and objectives described for each of the 
selections, nighty percent or more of tho items passed indicates functional literacy. 

7. Interpretation is made direcUy to the reading selections and their corresponding 
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3 DIRECTIONS FOR ADMINISTERING H/EAL 



FOR WHOM SHOULD f(/m. BE USED? 

VtAL should be used to assess whether or not an Individual is functionally literate. It 
Is particularly suitable for minority populations, such as Blacks. Puerto Ricans. Mexican 
Americans, rural groups, and all those" who have traditionally been singled out by the bias 
of standardized reading achievement tests. K/ZP^L is also suitable for adults at basic edu- 
cation levels. Although it has not been used widely with individuals under hith-school age, 
all indications are that it should be useful with anyone age ten or older. 

FOR WHAT PURPOSES SHOULD K/ZKL BE USED? 

• 

H/thL can be used both for diagnostic and evaluative purposes. It can, therefore, be 
used prior to instruction to determine if an individual is functionally literate and to identify 
particular areas of strengths and weaknesses. The Task Analyses should give the teacher 
some specific areas on which to concentrate. 

As an evaluation tool, VEAL should be used to deteimine whether or not a student has 
met the standard? of literacy after instruction. It can also serve to Indicate whether or not 
groups of students in a given program or situation have mastered basic literacy skills. In 
any case. It should be used v;hen the intent is to assess whether or not the individual is 
capable of performing reading tasks common to daily experience. 

MATERI/aS REQUIRED FOR ADMINISTRATION 

For each individual: 

o I VEAL test booklet 

o 1 H/EAL cassette tape 

o 1 cassette tape player and ear^u^ones * ' 

o 1 pencil t 

For each administrator: 

o Additional pencils and erasers 

o Additional copies of test booklets and cassette tapes 
o Additional players and batteries 
o Veal Examiner's Mammal 

PROCEDUIJES rOR ADMINISTRATION 

One of two different organizational setups should bo selected for the administration of 
H/EAL. The plan chosen depends in existing conditions, availability of equipment, etc. 
In deciding which plan to use, the examiner should bo guided by such factors as 1) total 
•nuinhor of stvcicnff to bo lc-sif-'«. '/.) nv«>f':"I»ility of ccj.s nt, ;uy\ 3) nv:ti!-th!c ;: r 
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«.„I^I.?.«!r^''''T ^^?*"**^«^f «o entire class at a time or to a number of classes 

consecutively. In order to administer B/ZAL in this manner, the examiner must 

o Obtain one tape recorder and earphone for each student. 

o Assemble players and other equipment in a rcom suitable for testing. 

o Explain workings of player and purpose of testing to group. 

o Allow students to begin test when ready. 

o Upon completion of test (times wiU vary), allow students to return to their usual 
pursuits; make provisions for such return. * 



Prepare materials for additional testing if other groups are to be tested. Rewind 
tapes and provide new booklets . 

o Make provisions for new students to enter and be tested. There is no need to wait 
rrcf ^'^"P,^^^ ""^5,^*^^ ^^othoT entirely assembled before new students begin the 
xesi. A student can begin as soon as space becomes {available. 

J^\^ the Ideal way to test large groups of students in a short time. As many as 150 
^^tTlHr.^ T ^^^if"* examiners. Although students 

l?n^r^Tt '^"^ ^^"^ individually since each student has his 

mvn recorder and so controls the pace of the input. Students are not bored waiting for others 

rifl^ T T ^^"^^ others are waiting for them to finish. Students 

can leave when they complete the test. The administrator's role is diverted to concern for 
f^^!?Int^M ' , "^r. response. In a large study conducted by the author n 

a residential center, students indicated that testing through these means was highly motivat- 

One difficulty with this approach is that sufficient equipment may not be available tt«,« 
ever new equipment can be purchased for about $25 per student equ^p^^^^^^^^^ 
players and earphones) can then become a permanent part of a materials cente^and u^fd Sr 

m 

J!lan B - Small Group o r Individual Administration (Examiner Not Present ^ * 

AdJ^i^.^'^D^'/rA/'; ^^r*/"*^^*^'^ ^o individuals or a few students at a time. In order to 

administer R/EAL Jn this manner, the examiner must . 

o Obtain tape players and earphones. Cf It Is possible to use only one or two players, 
then fewer students can be tested at one time.) , z vwv piuycrs., 

o Prepare auprcprl.ite tonMnrj faclHtf^'-, dcpomllng on Oic nu::;bcr of r.tudonts to b- 
tested at on^i iij;.o, 
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o Arrange a testing schedule so that students will know when they are to be tested ' 
Then, one student can complete the test and give the recorder and earphones to another stu- 

ible? or to^^ndividL'ir^*"^^ ^^^^"""^ ^""^ ^® Purpose of testing to total group. If poss- 

^i^"^ individuH students to begin testing and arrange for an appropriate place ^vhere 
tnoy can turn in completed materials. 

This situation is suitable when only some of a group are going to be tested or when it is 
Impossible to assemble the necessary equipment to assess the entire group at one time. It 
IS also useful when students enter a program at different times. The examiner's role in this 
situation is to arrange space and materials and to be available if help is needed. He is not 
expected to be directly involved when the student is taking the test. Through this procedure, 
a Jargc group can be tested in a short time with a minimum disruption of «ie class and 
UtUe direct use of the teacher's time. 

A third plan has also been tried in some situations. This plan should be used only when 
it is impossible to obtain a sufficient number of recorders and all students must be tested 
at once. Using this plan, the examiner must 

o Obtain one recorder. 

o Locate testing facilities. 

o Explain purpose of testing to group. 

o Indicate to students that they must look up or raise their pencils as they complete 
each question. *^ 

» 

o Familiarize self with items on cassette tape to facilitate operation 9f player. 

o Operate player by turning it off and on between each item. 

o Allow sufficient amount of time for all studer.ts to complete each item. 

This plan should bo used only when it is impossible to obtain equipment, since many of 
the motivational aspects are negated by having an examiner controlling the testing*. 

PRKPAPJKG THE SUBJECT FOR THE TEST 

The motivation most helpful to valid testing is a desire on the part of the subject that 
the score be valid-that it be an honest and true measure of his ability and achievement 
Too often, an autocratic approach is followed and the results become the private information 
of the tester, who then bnros rrcomnonr'r.llonr 0:1 them. K/KAL iidvocitor. thnt 0- . - ■ . 

dlftclnro t'*^ r«vrr'.'>-o ^. * <?.•• 't. . ..« • - .• - . ... 
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Proper preparation of the subject can reduce anxiety. He should be told that this test 
Is to be used to help him learn about his ability to deal effectively with everyday reading 
materials. The stress should be on whether or not he has mastered the tasks, not how ho 
scores relative to others. The unique format and materials of R/EAL reduce the disadvan- 
tages inherent in standardized tests of reading achievement and thus should furtlier reduce 
subject anxiety. 

ROLE OP THD EXAMINER 

Whichever test administration plan is selected, the role of the examiner in the admin- 
istration of IV'EAL is important, although R/EAL does not require a trained examiner for ef- 
fective administration. All the information required to understand what Is to be done in 
taking R/CAL is carefully described on the cassette tape. 

The function of an examiner of R/EAL prior to test administration is to assemble the test- 
ing materials: t 

o The test booklets 

o The cassette tape players 

o The earphones 

o The cassette tapes 

o Spare batteries 

o Examiner's Manual 

o Pencils 

The functions of the examiner during the test are to 

o Describe the test materials, 

o Distribute the test' materials. 

o Instruct each student in the operation of the cassette tape player and earphones, 

o Settle the students comfortably at a table where they can work, 

o Assist each student with any mechanical difficulties during the test, 

o Operate the recorder if group testing is used. 
The functions of the examiner after the test are to 

o Collect all test materials or make ready for next respondent. 

o Check the front page information to make certain the student's name is legible. 

o Rewind the tapes. 

o Clean earphones . - 

o Score all vc^po,\t.a& by iffoirino to t!)o sro'-Jm !:oy p:cv)Mcd in thiy taunu jl. 

o l?cc<.r.i nil 5 coro Jnfoif.^.iion in the rp.xc provicJcd on ilxa infado back cover o£ the 
tost booklet. 

/ 



o Compute subtest totals, raw score total and convert raw score total to perujnt of ' 
items passed. 

o Decide if the Individual should be judged functionally literate. 

o Determine which of the nine reading areas arc causing difficulties, if literacy has 
not been attained. 

o * Select one area in which to begin instruction. 

o Plan Instructional strategies and materials based on the Task Analysis for the se- 
lected reading criterion. 

o Initiate reading instruction. 

o Provide test data to other interested personnel. Including the student. 
TESTING CAUTIONS 

Caution ngainst coach inq. In order to encourage the best performance from an individual 
or group, the examiner should be sure that all the students understand clearly what they are 
to do and the manner in which they ere to record their responses. In assisting them, how- 
ever, the examiner must remember that this is a test situation and not a learning activity. 
In no wiiy should the concct response be indicated for any item except the example. If i 
student asks for assistance in understanding a question, do not answer the question but 
reas«;uro him that no one would be expected to respond con^ectly to all items and that he 
should Just do the best he can. 

irrcgulnritfcs during toFting. Irregularities can invalidate the score. It is recommemlc-d 
that Uie examiner note, in writing, irregularities involving individual students: for ex.impJc, 
anyone experiencing sudden illness, or anyone becoming unduly disturbed by the test sit- 
uation or tl)0 mechanics of the tape player, etc. The examiner should also note any unus- 
ual problems with the equipment. In addition, the examiner should note any pupil w^h 
physical handicaps tliat might in some way affect his performance on the test. A record 
should bo kept of unusual interruptions, or distractions such as excessive outside noise or 
unexpected visitors. This record should be made available to the individual in charge of 
Interpreting the test, 

Gucssinft. Most multiple choice tests urge that no statements should be volunteered to 
the student about guessing. Many Incorporate a correction for guessing. This is done to 
avoid chance responses that could invalidate the test results. But since n/r.hh is a con- 
structed- response test rather than a multiple- choice test, chance guessing is unin:ely to 
occur. The student must write his response rather than select from a number of por.siblo 
ans;vers. Guessing can still occur, however, whenever a student does not understand either 
the question or tlic roodinci material or both. R/EAL encourages the student to rcr.Donci, .«;ince 
any response is preferable to none at all. A response can be used to better interpret the 
shortcomings of the student. Guessing is not a matter of pure chance. Even on items ho 
knov/s least about, the student's experience and common sense should permit him to make 
a response. 
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4 STEP I 

1, Preheat oven to 4?5* f . 

?. Pet psm flour ftifx tn s smati 

3. A*? j * » cur '•^fy A.!r •• / ,??cf to 

Stff vifcCfOuS'/ fc.f ^trci'.es. 

4. CovtH to^l. let stand rji A8fm 
place ftr 6 p.^if^es. 



STEP II > 

5. Ustng shoftmng grease ftcEftf 
14* p^:* pSR or a ^ W 

6. Greaso ffn^rers or dtp i^e^n 

dv^u^n to e(2;:es ot p^n. f*.n;n 
^^Pf^fcesu'to torn um. 

7. Pour canned pirra S3uce over 
tfPttR*> Spread to eiges. 



•4 STEP til 

8. Sprmkle cheese f «r mocc. 

9 Bsks in prfchesfed o.«n for 
I6-2J m.itjfes. or unUl crust i$ 
desired ^^^^*f»ness. 

10 Seu'emrrediatefy 



Make up pt7M dougn as 3.rc:te3 stove, Co»ef A.th aiufr.iium f<xi or p;astic 
*flp ft a $;ef€ in refftper »tof up to 4 hours Do m put pfz;3 sau^e or cfieese 
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WHAT ARE NARCOTIC DR 



The tem narcotic refers^ gentrally, to opHim and 
pain-kiiling drugs made from opium, such as heroin, 
morphine, p^^goric; and codeine. These and other 
opiates are obtained from the luiceof the poppy fruH. 
Several synthetic drugs, such as demerol, and dofo* 
phine; are also classed as narcotics. Opiates are widely 
used In medicine as pain kilters. Cocaine, made from 
coca leaves, and nnarBiuana are clas^f led legally but 
not chemically as naicotic drugs. 

Since heroin ^>pears to be the narcotic used by 
most addicts today, these questions and answers deal 
mainly with heroinu 

WHAT IS NARCOTIC ADDICTION? 

When the abuser of a narcotic gets ''hooked'' - 
meaning addicted - his body r^uires repeated and 
larger doses of the drug. Once the habit starts lar^ 
and larger doses are required to get the sameeffectSL 
This happens because the body develops a "toler- 
ance" for the drug. 

One of the signs of heroin addiction is withdrawal 
sicknessL When the addict stops using the drug, he 
may sweat, shake, get chills; diarrhea, nausea, and 
suffer sharp abdominal and leg cramps. Modern treat- 
ments help the addict through these witMrawal 
stages. Science now has new evidence that the body's 
physical addicticn may last mudi longer than pre- 
viously believed. 



There h anotfiar kind of drug d^wiKfence corv 
meted with the use of narcotics. This is known as 
psychological dependence. That taking the drug 
also become a h^t for emotional reasons For ex* 
ample, tte addict comes to depend on the drug as e 
way to esc^De facing tifa 

Narcotic use can beconw evm more of an escape 
than expected, because large or unexpectedly pure 
doses can and not uncommonly do result in death. 

WHAT IS THE EFFECT OF THE DRUG? 

Typically, the first emotional reaction to heroin 
is reduction of tenstor^ easing of fears and relief from 
worry. Feeling "high" may be followed by a period 
of inactivity borderir^ on stupor. 

Heroin, which is usually mbced into a lk)uid ^lu* 
tlon and injected into a veii^ eppears to dull the edges 
of reality. Addicts have reported that heroin "makes 
my troubtes roll off my mind," and '<it makes me feel 
mora nire of myself/' 

The drug depresses certain areas of the brain, and 
may reduce hunger, thirst, and the sex drive. Because 
^icte do not usually feel.hungry, their hospital care 
ntay include treatment for malnutrition. The drug may 
also redura feelings of pain. 

WitfKlrawal symptoms appear in the addfeted per* 
son about 18 tours after the drug has been discon* 
tinued. 

In general, effects of the drug are influenced by 
many factors. These include the user's personality, 
sire and frequency of dose, and how the drug is teken. 

WHO TAKES NARCOTICS? 

Studies by the VS. Public Health Service shw 
that heroin addiction today is foumf chiefly among 
^ng men of minority groups in ghetto areas. Of 
the more than 60,000 known addicts listed by the 
Bureau of Narcotics ami Oar^erous Drugs, more than 
half Ihre in New York State - and most of them in 
New York City. Recent figures show that more than 
half of the addicts are under 30 y^rs of age. 
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AND THE LESSOR AND LESSEE for themselves, their heirs, executors, administrators and assigns 
do heicby covenant to and with each other as follows: 

1 . Th»t the «fore«*i<J rental iJiall include the cost of gM for normal rooking PHr?S?^5!?* f.'S;?^j5?J^»''*J*™™»?* 
lighttng and usual household appliance purposes used by Lesseo on said premise*. PROVIDED. HOWEVER, inat the 
Lessor shall not be liable to Lessee or to any other person for damages or injury resulting from temporary failure of the 
electric or gas service. Lessee agrees not to insuli or operate in said apartment or building, any etectric air condition- 
ing machine, washing machine, or deep freeze, nor erect any outside television aerials without first obtaining the written 
consem of the Lessor, which consent may be revoked by Lessor at any time. 

2. The Lessor shall not be liable for failure to delivw possession of said premises at the time stipulated herein 
u the date o*" ihe commencement of the tenancy, nor shall such failure excuse the Lessee's irfdigauon hereunder, except 
that In the event of delay on part of Lessor Ui delivering said premises to Lessee, the nnt herein stipulated to be paid 
by Lessee shall be abated for the period from the date of the commencement specified In this agreement to the date pos- 
session is tendered to Lessee. 

• 

3. The Lessor hereby covenants and agrew with the LesMe to fumteh without additional cow, hot and cold 
water to all fixtures provided for the same» heat at aU proper seasons of the year to radla^rs where installed, electric 
light bulbs and electric fuses at the time when Lessee takes possesion tmi not thereafter, if Lessor shall furnish Vene^ 
tian Blinds* same are to remain the property of Lessor. 

The Lessor has installed an electric refrigerator and gas range in the demised premises, and under no condition 
shall said equipment be removed from said premises. The use by Lessee of his own or any other such equipment In said 
premises is hereby expressly prohibited. 

4 And the said Lessee agrees that he will tu>t use said premises or any part thereof for any disorderly* imprcqier. 
objectionabte or unlawful purpose, or for any other purpose than as a private dwelling as aforesaid; that he will not 
transfer or assign this agreement or sublet or transfer possession of said premises or any part thereof, to any person or 
persons without the written consent of Lessor Arst had and ^obtained, and only then under conditions as set forth by 
the Lessor; and be will not permit any additional persons to occupy the apartment without written permission: of Lessor; 
that he will not place any signs or other advertising matter upon the doors, windows or walls of said demised prem* 
ises or said building; and said Lessee agrees that if said Lessor shall deem the tenancy of said Lessee undesirable 
by reason of objectionable or improper conduct on the part of said Lessee or his family or visitm^ to his apartment. 
» by reason of conduct or actions of the persons aforesaid^or any of them, causing annoyance or disturbance to other 
t6ii0nt<i in said building or adjoining buildings, then said Lessor reserves the right to terminate this agreement by giv* 
Ing 4^--:>see personally, or by leaving at the demised apartment, a five days' 'written notice to quit and vacate said de- 
m£ed premises and may take possession thereof without legal process or may avail itself of any remedy provided by law for 
Che restitution of possession. 
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JOB APPLICATION 



AOIXIE$SL. 



.DATE Of BIRTH. 



MOW LONG HAVE YOU UVEP AT THE ABOVE AODRESST. 
FATHER'S FULL 
MOTNEfTSniLL 



Iw» A^lM* MttrtolMKM NiMM» ftlNrtelMflM 0« Acmm» Of 
.CODE 



-TEL.. 



.HOW LONQ HAVE YOU UVEO IN THIS CITY? 



.WHERE EMPLOYED. 



.WHERE EMPIOYEGL 



NAVE YOU PROOF OF AQET. 



JS ANYONE OEpInDENT ON YOU FOR SUPPORTT 



JWHOL 



WHERE EMPLOVem 


MARK *X' IN SQUARE THAT FITS YOUR CASE 


NO. CHILDRCM^ aoes 


□ SINGLE 

□ MARRIED 


□ UVINO W/PARENTS 

□ NOUSEKEEPINQ 






NAVE YOU A REUTIVE NOW EMPLOYED 
IF SO. GIVE NAME AND BEtATIftM 




□ WIDOWED 

□ SEPARATFJ) 


□ LIVING W/RELATIVE8 
a BOARDINQ 


WHERE EMPLOVEm 


□ OIVOf^EO 


□ ROOMING 




♦POSITION APPLIED FOR 
' • IF TEMPORARY POSITION. PLEASE INDICATE. SIGNATURE OF APPUCANT 
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Name Date of Testing 

SCORING RECORD FORM 



Road T«l«v{sion ChMW Nveetie Food Lmm Road Wmt Job 

Sgns GalM<titl« Pins Otugt Ad Mn» Ad Applie«t)on 

1. 1. 1. ^ 1. 1 1 1 1... 1 

2 2. 2. 2. 2 2. 2. 2 2. 

3L 3. 3l a 3 3L 3 3. 3. 

4. 4. 4. 4 4 4. 4. 4. 4. 

5 6 5. 5 6 5 B 5. P 



Subtwt 
Tetak 



In the spaces above, mark 1 1f the student responds correctly and 0 if response . 
is incorrect. Sum tlie numtjer of correct responses in each column to give the Totii 6eo»» 

Subtest Totals. Sum across the bottom row tc give the Total Score. Convert 
the Total Score to Percent Passed by referring to Table . 



Individual Analysis 

Based on tow test performance (0 or 1 subtest total) this student should 
concentrate on the following areas: (check appropriate ones) 



Road Signs Narcotic Drugs Road Map 

TV Schedule Food Ad Want Ad 

Cheese Pizza Lease Job Application 
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Directions: This is a test of how well you understand what you read. The test has stories 
for you to read and questions about the stories for you to answer. Read each story; then 
ans^t'er the questions that follow it. Mark the space on your answer sheet that matches 
the letter of the answer you choose. Here is an example: 

"Make u wish and blow out the candles!" That's something people have been saying to 
birthday children for hundreds of years. Long ago, people thought that candles had 
magic powers. The candles on a birthday cake had the power of granting a wish. To get 
the %vish the birthday child had to blow out all the candles at once and keep the wish 
6 a secret. Today, most people don't believe that candles have magic powers, but the 
custom goes on. 

St, To get his wish, the birthday child had to 

A. eat a piece of cake 

B, keep the wish a secret 

C. say the right magic words 

D, find the special birthday candle 

S2. In line 4, "at once" means 

A. right away 

B. one by one 

C. at the right place 

D. at the same time 

The best answer for question SI is B. "keep the wish a secret." so you should blacken 
space B for question SJ in the Reading section of your answer sheet. The best answer for 
question S2 is D, "at the same time." You should blacken space D for question S2 in tjie 
Reading section of your answer sheet. \ 

Remember to blacken only one space for each question. Make sure you blacken the 
correct space for your answer. You can look back at the story when you are answerirm 
the questions. If you wish to change an answer, carefully erase your first answer and 
then blacken the space for your new answer. 

When you are told to begin, work until time is called or until you come to the words 
STOP HERE. 



"I heard you have two women locked up." commented the reporter from the Clarion: 
"What s the charge?" 

"Assault and hatter), ' replied the sheriff. "One is a Mrs. Smith and the other a Mrs. 
Jones. Theyve been cooling their heels since three o'clock. Their lawyers are on their 
s way here now to post bail." 

"What happened?" asked the reporter. 

"Well. Flit s Department Store held their Dollar Sale today. Since it was raining, the 
umbrella department was really crowded. The ladles started a tug-of-war over a purple 

unibrtlla. Tint s it ovi r tliciv on the lablt. It II Ix- c.xlubit A al the trial. Haeh lady claims 
10 s\w Hitw It first. Smith s;ns join's hit Iht on the arm w itii the unihrflhi. Joncx is siiiKini; 
a different tunc. She says Smith ga\e her a belt on the head with a bag of liai d candy. I he 
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candy will be exhibit B. When a salesman tried to stop the fight, they let him have it 
He'tt be out or the hospital in a %veek/' 
The sheri^ leaned back* yawned, and looked at the clock. "It's five o clock. Deputy 
IS Slat will be coming on duly. Til wait until tomorrow to mark those exhibits." 

A tall young man swaggered into the room a few minutes later. He drew two imaginary 
six-guns and growled. "My name is Wild Bill Hickok, I'm here to take the night watch." 

"Your name will be mud if you don't finish that report on your desk/' said the sheriff. 
**ril see you tomorrow." 
so "You can always depend on Wild Bill/' replied Slat as the sheriff and the reporter 
walked out the door. • 

He sat down and began to work. I could eat a bear, he said to himself, and glanced 
around the room, Hey. what s that over there? He walked over to the table and filled his 
mouth with candy. Loud cracks filled the room. Ummm. good. Til eat the rest of it while 
s& I work. And here's an umbrella. That will come in handy when I go home. The sheriff 
won't mind if I take it— it s all torn up anyhow. 



1. The story takes place in a 

A, courtroom 

B. newspaper office 
C department store 
D. county Jail 

% Mrs. Smith and Mrs. Jones could best be 
described as 

A* thoughtful 

B. violent 

C. jealous 

D. innocent 

3. The next time the salesman sees two people 
having a fight, he will probably 

A. refuse to get involved 

B, try to pull the fighters apart 

C. explain to them why they shouldn't fight 

D, call a reporter 

4. When the sheriff says "Jones is singing a 
different tune/* he means that she is 

A* telling another side of the story 

B. screaming for her lawyer 

C. agreeing with Mrs. Smith 
singing an unusual song 

5^ Why Is the sheriff really to blame for what 
Slat did:^ 

A* He shouldn't have gone so early, 
B. He should not have allowed Sfa* i ^ be alone 
on dtifv 

C Me kiH-w that Slat was rJuir. . . w 

D. Hi* didn I mark ihi.* umbuJla ;uk( canclv as 
exhibits. 



6. In line 1 1 . belt means a 

A. strip of leather 

B. safety strap 
C« blow 

D. song 

7* Who has the most reason to sue Mrs. Smith 
and Mrs. Jones? 

A* The owner of Flit s Department Store 
B* The salesman 
C The sheriff 

D. The reporter from the Clarion 

8. Deputy Slat was going to be in trouble for 

A. talking back to the sheriff 

B. impersonating Wild Bill Hickok 

C. leaving work early 

D. taking evidence 

9. Which of the following statements is an opin- 
ion rather than a statement of fact? 

A. The sheri^ can always depend on Slat. 

B. Mrs. Jones and Mrs. Smith had a fight. 

C. Both ladies claim they saw the umbrella 
first. 

D. The salesman is in the hospital. 

10* When the sheriff left for the day. he assumed 
that 

A. Mrs. Smith and Mrs. Jones would try to 

escape 

B. Slat would not finish the report 

C. the allorncys would not arrivr with hail 

D. no one would lotic h the evidence 
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Color serves a protective function for many animals. It makes some hard to sec against 
their backgrounds. This helps to protect them from their predators -other animals that 
kill and eat them. Color also serves to protect some predators. It warns them that some 
animals they would like to eat can harm them, 
ft Many insects are the color of leaves, twigs, or bark. When they rest quieUy on a plant 
or tree, their predators have a hard time spotting them. For example, the underwing, a 
kind of moth, has gray-and-brown wings that blend with the color of bark. 

The color of some animals changes to blend with their backgrounds. The arctic hare, 
a rabbit, is brown in summer. In winter its fur becomes white to match the snow on the 

10 ground. The color of some animals changes more quickly. The mosquito fish, for 
example, becomes darker or lighter to match its background as It moves around. 

Some investigators experimented to see if color really does protect animals from preda- 
tors. They put mosquito fish in a tank with a white bottom. A few hours later all the 
fish were light-colored. The investigators then put half the fish in a tank with a black 

IS bottom. They immediately freed penguins, seabirds that eat mosquito fish, near the 
two tanks. After several hours they counted the number of fish In each tank. Most of 
the fish in the black tank hud been eaten. Most of th'? fish in the while tank were still 
alive. 1 hus the investigators found that color does protect mosquito fish. But color is 
not a foolproof source of protection. 

ao Color serves as a warning to some predators. Some animals are poisonous, sting, 
give off a baJ smell, or taste bad. Many of these animals are brightly colored. They are 
easily seen by predators. 

Investigators experimented to see whether predators know instinctively which bright- 
colored animals to avoid or whether they learn only by experience. In their experiments 

25 they I ied monarch butterflies and blue jays. Monarchs have bright orange-and-black 
wings and are believed to taste very bad. The investigators put a hungry young blue Jay 
into a cage with the monarchs. The blue jay caught and ate just one. It did not chase 
any others. 



11. In line 7. bark means 

A- the sound a dog makes 

B. a loud and angry cry 

C. the outside of a tree trunk 

D. a kind of beetle 

12. Where would you be LEAST likely to find 
animals like the arctic hare that change color 
in winter and summer? 

4. Canada 
fc. Florida 

C. Alaska 

D. Colorado 

13. In the test with mosquito fij h. what did the 
investigators find when they counted the fish? 

A. All the fish in both tanks had been eaten 
by the {x'nguins. 

B. About half the mosquito fish In each tank 
bad been eaten. 

C. The pt nj^um-; luv) cid'n imnc fish Irom 
the hl.ii'f. l.irik than fioiu the uhiic Link 

D. I'cnguin.N don t like nio.s(|uitu hsli and .so 
had eaten only a few. 



lU 




14. What was the investigators' last step in the 
test with the mosquito fish and penguins? 

A. They counted the number of fish in each 
tank. 

B. They freed penguins near the tank. 

C. They placed mosquito fish in a white tank. 

D. They put half the mosquito fish in the 
black tank. 

15. After they placed the mosquito fish in the 
white tank, the Investigators waited before 
placing half of them in the black tank. Why 
did they do this? 

A. They wanted to make sure the penguins 
would be hungry. 

E. It took several hours for the mosquito fish 
to become light-colored. 

C. It took several hours for the mosquito fish 
to become dark-colored. 

D. They had to count the fish in the tank. 
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16. In line 15. freed means 

A. gave 

B. unfastened 

C. released 

D. banished 

17» Based on the story, why did the penguins eat 
more fish from the black tank than from the 
white tank? 

Au The fish in the black tank moved more 
slowly than those in the white tank. 

B. The fish in the black tank were still light* 
colored; the penguins could see them better 
than those in the white tank. 

C. The fish in the black tank could not see 
the penguins as well as those in the white 
tank. 

D. The fish in the black tank had no waining 
color, so the penguins didn't know they 
tasted bad. 



18. Animals that sting, give oft strong smelts* 
or arc poisonous often get away from preda*^ 
tors by 

A. killing them 

B. blending with their backgrounds 
C warning them with bright colors 
D. changing color 

19. What happened when the investigators put 
the blue Jay in the cage with the monarchs? 

A* The blue jay ate all the monarchs. 

B. The blue Jay did not try to catch any 
monarchs. 

C The blue jay caught and ate one monarch. 
D. The monarchs flew away from the blue 
Jay. 

20. What did the investigators learn from the 
experiment with the monarchs and the blue 
Jay? 

A. Blue jays learn to relate color and bad 
taste. 

B« Blue Jays can't see monarchs clearly. 

C. Blue Jays have small appetites. 

D. Blue jays don't like orange and black. 



Sometimes new fields of knowledge start by accident. One such field in the area of 
indusurial psychology was the study of workers' feelings about their jobs. 

Once, workers' feelings were not considered very important. Employers thought that 
good pay and safe physical conditions were all that mattered to workers 
ft In 1924 the managers of the Hawthorne plant of the Western Electric Company de- 
cided that their workers could work faster if they had better lighting. The managers 
hired experimenters to find out how much light the workers needed. At first, this 
seemed simple. The experimenters watched some women whose Job was winding coils 
of wire* and they kept track of the number of coils the workers could produce when the 
10 lights were dim. Then they made the lights brighter and measured the workers* pro- 
duction again. Just as they expected, the women produced more each time the light was 
made brighter. 

Then a surprising thing happened. They switched back to dim lights, but the workers' 
production didn't decrease! The workshop was still a beehive of activity. Something 
1$ besides the increase in light must have been causing the women to work harder. 

More experiments followed. The investigators found that workers almost always pro- 
duced more when they were subjects in an experiment, even when the lights were so 
dim they could hardly see. The experimenters were very puz/.led. Finally they realized 
that the coil winders were working very hard because the experiment made them feel 
so important. They felt that the company cared atraut them because they were getting 
spccini attention by hofn^ in the experiment. 

The way this feeliuK of iinportaficc' atlccted the workers' production is ciiWvd the 
Hawthorne cffcct^ Its ciiseovery was a nntjor event in the drvolopinent of indiislria! 
psychology. Employers learned tluu workers' feelings were important after all. 

/ 
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21. If the workshop was a "beehive of activity," 
the workers must have been 

A. talking to each other 

B. wandering around 

C. making honey 

D. %vorking quickly 

22. The Hawthorne plant managers hired experi- 
menters to find out 

• 

A. how many coils a worker could wind 

B. how much light they should put in the 
workshops 

C how workers might be made to feel 

important 
D. how workers might be influenced 

23. How did the workers probably feel about their 
Jobs during the experiment? 

A. They liked them because the work wasn't 
very difficult. 

B. They disliked them because the work was 
more difficult during the experiment. 

C. They liked them because the workshop was 
a bright, cheery place. 

D. They liked them because they felt that what 
they were doing was important to the 
company. 

24. In line 20. felt means 

A. touched with the fingertips 

B. proved 

C. believed 

D. a kind of clotli 

25. The production by the workers in the experi- 
ment increased mainly because of the 

A. %vorkers' desire to beat each other 

B. workers' desire to earn more money 

C. improvement in lighting 

D. special attention the workers received 

26. How did the experimenters measure the 
workers' production? 

A. They watched to see how hard the people 
worked. 

B. They kept track of the number of coils 
wound. 

C. They recorded the amount of noise that 

was made 

D. Tlu'v counted ihc nuinlxr of tiiiics eat-li 
worker looked at the light. 



27* What did the experimenters try to find out 
after the surprising results of the first 
experiment? " 

A. How the workers felt about being in an 
experiment 

B. How much the (H>il winders could produce 

C. What was affecting the women's work be- 
sides the amount of light 

D. What kind of light was best for the workers 

28. Why does the author describe the experiments 
at the Ha^^thorne plant instead of a more 
recent industrial psychology experiment? 

A. The Hawthorne experiments were very 
important in the development of industrial 
psychology. 

B. There haven't been any industrial psy- 
chology experiments since tlie Hawthorne 
effect was discovered. 

C. The recent experiments are more difficult 
to explain. 

D. There is no particular reason that he 
chose this example instead of some other 
one. 

29. Why didn't the Hawthorne experiment solve 
the problem it was supposed to solve? 

A. The experimenters didn't know what they 
were tiding to find out. 

B. The experimenters were trying to find out 
too many things at once. 

C. The results showed the effect of only one 
thing instead of the effects of many things. 

D. The results depended upon the effect of 
something other than the thing that was 
being studied. 

30. What was the first sign that the workers' pro- 
duction was being influenced by something 
besides the amount of light? 

A. The workers said the experiment made 
them feel important. 

B. Production didn't decrease when the bright 
lights were replaced with dim ones. 

C. Production increased each time the light 
was made brighter. 

D. The investigators found that workers pro- 
duced more when they were part of an 
experiment. 
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The violins swam in and out of each other's waters. A flute skimmed the surface like 
a dragonfly Two bassoons vibrated m the depths. The music lingered on a last green 
note before the pause. . . , * 

And then like a belch at a ladies* luncheon came the reckless ta-ta-ta-rum of a slide 
5 trombone, a tumidt of su-ident sound. Maestroni's ecstasy crumbled. "If you do that 
again. Ill kill you! he screamed. . j » 

Albert, the third trombonist, wriggled lumpishly on his stool. The other trombonists 
stared stonily ahead. The orchestra was still in awe of the high-tempered genius a its 
head. Maestroni was conducting only one performance, and rehearsal Ume was limited. 

I hey played the piece again, tension mounting as they approached the luckless pause 
But the silence endured its proper span. Maestroni. black-browed. Jabbed pointedly at 
the rrombones when their time came, and this time they resounded In unison as required. 

After the rehearsal Albert went home disconsolately to his mother. "My first big blun- 
der, he sobbed, and in front of // Maestro himself. What will become of me?" 

After forty years of caring for Albert, his mother stiU didn t understand his fascination 
with music. Why don t you sive up that tromboner She had said the same thing every 
night for twent)' years. 

.u7"o v^""*' " P'®^^"^ ^''^^^ »5 he did every night. "Why do you say such 

things? You arc tone deaf. How can it disturb you?" y»»y^» say sucn 

1/ 2V^}^^^^ Maesux)ni who has upset you." muttered his mother to herself. "I will show 
// Maestro where he belongs." 

"'^^ follo%ving evening. The orchestra relaxed and played 

TK. S?^ T'^^''^ ^^"^^"^^ ^'"'^^ clarinets circled about them. 

The oboe hovered at a distance. The memorable pause drew near; the violins sighed 
» and slept, overpowered by their own beauty. The oboe crept away. The bassoons were 
dreaming. Maestroni wore an expression of serene complacence 
rZ^^'lf^^^hY^'"^ the concert hall was hushed and awed, the unspeakable hap- 

t / M^^"^ "^''^ ^^"^^ of hall and blew a long, louj 

malevolent call on Albert s spare trombone. 
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31. In the first paragraph, the music reminded 
the author of a 

A. storm on a river 

B. spring meadow 

C. deep, green forest 

D. peaceful lake 



wriggled lumpishly." he must 



32. When Albert 
have moved 

A. suddenly 

B. awkwardly 

C. noisily 

D. slowly 



33, Where was Albert at the beginning of the 
passage? 

A. In the orchestra at a rphcarsal 

B. At home with his mother 

C. In the orchestra at a concei t 

D. In the third row of the orchestra pit 




34. Who is Maestroni? 

A. A guest conductor 

B. An opera singer 

C. A trombonist 

D. A violinist 

35. If the trombones 'resounded in unison." 

A. one was played after another 

B. they were blo^vn softly 

C. each played a different note 

D. they were all play&i together 

36. How did Albert's moth<;r feel about Maestroni? 

A. Indifferent 

B. Puzzled . 

C. Scornful 

D. Coitcei ned 
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37. At the end of the passage. Albert's mother 

A. tried to sneak into the concert hall 

B. Uew the trombone in the audience 
C stole Maestroni's trombone 

D. gave Albert's trombone to a little old lady 

38. When Albert blew his trombone at the wrong 
time, Maestroni was 

A. tense 

B. insulted 

C understanding 
D. furious 



39. Toward the end of the passage. "Maestroni 
wore an expression of serene complacence** 
because * 

A. he was pleased with the orchestra's playing 

B. he didn't notice Ik>w the orchestra was 
playing 

C. the concert hall was filled to capacity 

D. the audience was applauding enthusiastically 

40. Albert's mother did what she did because 

A. she was tone deaf 
^ B. she was angry at Albert 
' C she wanted to impress // Maestro 

D. Maestroni had upset her son 



Anyone who has visited a zoo knows that man's closest relatives in the animal king- 
dom are members of the ape fsimily: gorillas, chimpanzees, orangutans, and gibbons. 
A few minutes of gazing at a gcrilla who is simultaneously studying you provides con- 
vincing evidence that man is not the only thinking animal. 
8 Of all the apes, the chimpanzee is probably most like man. A comparison of the 
early development of a chimp and a child can help a person understand what it is that 
makes man human. 

A newborn chimp de\'elops motor skills more rapidly than its human relative. Before 
a child can roll over, a chimp is crawling. By the time a child has mastered crawling. 
10 a chimp can run circles around him, 

A young chimp also grasps simple mechanical operations earlier than a child. In 
captivity, young chimps learn to unlock doors, to switch on lights, and even to start 
a car. These skills require manual dexterity, which a chimp instinctively develops as 
it plays. A young chimp will toy for hours with twigs and leaves, bending them and 
» poking them into holes. Later it uses these skills to make simple tools and to build 
nests for sleeping. 

Like a human being, a chimpanzee is able to analyze a problem and foresee the results 
of its actions. In fact, a one- to two-year-old chimp can solve problems as well as or better 
than a child of the same age. For example. In a "suspended cooky" test, a fourtecn-month- 
ao old chimp beat a seventeen-month-old boy in figuring out how to use a chair to reach the 
prize. 

When does the child leave the chimp behind? A baby chimp makes sounds when it 
needs something or wants to express a basic emotion, such as fear or anger. With a 
language of cries, shrieks, and gestures, it can communicate these needs or emotions, 
ss A child begins very early to babble. Slowly he begins to put these sounds together and 
to imitate the words he hears around him. Gradually he comes to understand the words 
of others- With speech and the meanings it represents, the child can communicate not 
only his needs, but also complex emotions and ideas. 

41. Which of the following most closely resem- 42. Young children and young chimpanzees differ 
Wes man? mainly in their ability to 

A. Gorilla A. run in circles 

B. Gibbon U. make uurd hounds 

C. Chimpanzee C. reach cookies 

D. Orangutan D. bend twigs 

s 
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43. According to the passage, which of the fol- 
lowing would be the correct order in which 
mntor skills are learned? 

A. Walking, crawling, rolling over 

B. Rolling over, walking, crawling 

C. Rolling o\^r, crawling, walking 

D. Crawling, rolling over, walking 

44. In line 8. motor means having to do with 

A. muscular movement 

B. an automob'Ie 

C. thinking 

D. an engine 

45. According to the passage, a chimpanzee can 
learn to unlock a door earlier than a child be- 
cause the chimpanzee 

A. is much more curious about what's beyond 
the door 

B. develops manual dexterity sooner than the 
child 

C. has longer arms than the child 

D. is born with nimble fingers 

46. Chimpanzees are often used to test new medi- 
cines. Chimps are probably used in such ex- 
periments because they 

A. can analyze problems and foresee results 

B. have greater manual dexterity than a child 

C. are so similar to man 

D. develop motor skills earlier than man 



47. Before a child can roU over, a chimpanzee can 

A. run * 

B. crawl 

C. skip 

D. climb 

48. In line 19, suspended means 

A. stopping 

B. removing 

C. hanging 

D. putting off 

49. According to the passt^e. the purpose of the 
"suspended cooky" test is to study 

A. manual dexterity 

B. general motor skills 

C. problem-solving ability 

D. types of play 

50. Assuming that the faster the physical develop- 
ment the shorter the lifespan, which of tlie 
following is probably true about chimpanzees 
and human beings? 

A. The lifespan of human beings is longer 
than that of chimpanzees. 

B. The lifespan of chimpanzees is longer than 
that of human beings. 

C. Chimpanzees and human beings have ap- 
proximately the same lifespan. 

D. Chimpanzees never live longer than five 
years. 



The English language was once very different from the way it is today. Linguists who 
have studied the histor)* of English say that it began as a branch of the German language. 
It was spoken by people who lived along the northern coast of Europe more than two 
thousand years ago. The language these ixK}pIc spoke would not sound anything like the 

6 English spoken today. 

English has changed a great deal over the years. This is because the first speakers of 
Enj^ish. who came to be known as Anglo-&ixons. came in contact with people who 
spoke many languages. In order to communicate with these people, the Anglo-Saxofis 
had to Icam some of their words. Once they learned them, they kept on using them. Soon 

w these words became part of the English language. 

For example, many common English words, such as huUct, cheese, street, and pound, 
were originally l^tin. They %vere added to English when Uuin-spcaking merchants 
began to trade with the Anglo-Saxons. Thousands of words became part of the English 
language in similar ways. 

ift Soinrtinifs words w ore adopted as a result of war. One example of this is !he Norman 
Conqui'st. The Normans, who spoke French, coiiqutiecl Kn$;laiKl in 1066 and ruled iht- 
land for Hcveial hundred sxms. Allliou^h most ol the people in Eimland continued to 
speak English, they began to use many of the French words that their rulers used. Tax. 

H* 
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» tnJ!^fZ%^t^t'''^ examples of words that were originally French and became 
10 part of the English language during the period of Norman rule 

^T^^SI^A^' '""S^^ ar*^ adopted fi-om other languages, and sometimes words must be 
coined to describe completely new ideas or recent discoveries. The Knclish lanruace 
is san^changing to suit the speakers' needs. Just as it has been changing t uiS 



51. In line 16, ruled means 

A. laid down a legal rule 

B. arranged in a line; lined up 

C. decided in a court 

D. governed, conurolled 

62. Which of the following words shows that 
English is still changing? 

A. war 

B. astronaut 

C. street 

D. beauty 

53. One general reason for many of the first 
changes in the English language was that the 
Anglo-Saxons 

A. hired an expert to simplify what was an 
extremely difficult language 

B. continually moved from place to place 

C. were forced to learn the languages of their 
conquerors 

D. came in contact with people who spoke 
many languages 

54. The author suggests that Latin words such as • 
butter and cheese were adopted by the Anglo- 
Saxons because these people 

A. had no words for these items before the 
Latin-speaking merchants came 
thought these words sounded better than 
the ones they had been using until then 
needed to know these words to talk with 
Latin-speaking merchants about these 
products 

D. had to use the words their Norman rulers 
used 



B. 

C. 



55. The author implies that in a few years the 
English language will be 

A. spoken in every country in the world 

B. replaced by a new, easier language 

C. very different from the way it is today 

D. slightly different from the way it is today 



a 
o 



56. Which of the following words was NOT made 
up within the last one hundred years? 

A. television 

B. wheel 

C. radioactive 

D. radar 

57. Which of the following does the author sug- 
gest rather than say? 

A. England was conquered by the Normans 
in 1066. 

B. The words street and pound are from the 
Latin language. 

C. Changes in the English language have been 
gradual. 

D. A form of the German language was the 
basis for English. 

58. Today, new words are added to the English 
language mainly to 

A. make it possible to talk about new ideas 
and discoveries 

B. pro%'e that English is still capable of change 

C. replace old. wormout words that have be- 
come boring 

D. keep English from becoming too much like 
Latin 

59. In line 20. period means 

A. punctuation mark 

B. end of a sentence 

C. division of the school day 

D. portion of time 

60. One result of the Norman Conquest was that 

A. trade between Latin-speaking merchants 
and the Normans increased 

B. many French words were added to the 
English language 

C. words that originally were English were 
removed from thn French language 

D. the Normans officially adopted the English 
language 

» 

STOP HCRE. 
END OF TCST 
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VOCABULARY 



Directions. This is a test of how well you know the meaning of words. For each question, 
choose the word that has most nearly the same meaning as the underlined word. Mark 
the space on your answer sheet that matches the letter of the meaning you choose. Here 
is an example: 

SI. begin the game 

A. win 

B. watch 
C start 

D. remember 

The best answer is C. "start," since it has most nearly the same meaning as begin. You 
should blacken space C for question SI in the Vocabulary section of your answer sheet. 

Remember to blacken only one space for each question. Make sure you blacken the 
correct space for your answer. 

When you are told to begin, work until time is called or until you come to the words 

STOP HERE. 



1. beyond the turn in the road 

A. near 

B. beside 
C at 

D. past 

2. an interesting topic 

A. book 

B. subject 

C' appearance 
D. memory 

3* occurs often 

A. happens 

B. looks up 
C tries 

D. fails 

4* awkward man 

A. h.ind«5omc 

B. clumsy 

C. friendly 

D. dreadful 



5. additional books 

A. school 

B. new 

C. extra 

D. large 

6. absolutely forbidden 

A. foolishly 

B. completely 

C. possibly 

D. needlessly 

7. enclosed with a letter 

A. remembered 

B. put in 

C. insulted 

D. informed 

8. a terrible nuisance 

A. accfdcni 

B. Sturm 

C. Kinell 

D. bvtlicT 



9. sound logic 

A. reasoning 

B. knowledge 

C. example 

D. excuse 

10. the ^adual increase 

A. helpful 

B. sudden 
C slow 

D. alarming 

11. tends to walk slowly 

A. is likely 

B. needs 

C. has a right 

D. tries 

12. genuine feelings 

A. friendly 

B. true 

C. hurt 

D. personal 
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13. possess a car 

A. drive 

B. park 

C. borrow 

D. own 

14. s tability of the chair 

A. covering 

B. style 

C. Fteadiness 
' D. usefulness 

15. the annual report 

A. book 

B. yearly 

C. poor 

D. final 

16. accomplis h the task 

A. assign 

B. understand 

C. accept 

D. finish 

17. phantom of the castle 

A. owner 

B. moat 
C ghost 
D. keeper 

18. practical machine 

A. old-fashioned 

B. expensive 
C complicated 
D. useful 



19. easily hoisted 

A. replaced 
a lifted 

C. forgotten 
D; made 

20. particle of coal 

A. handful 

B. truckload 
C tiny piece 

D. samjke 

21. inhabit the house 

A. live in 

B. buy 

C. invade 

D. build 

22. hesitant attitude 

A. undecided 

B, positive 
C cheerful 
D. serious 

23. fret over 

A. cross 

B. argue 

C. worry 

D. fly 

24. controlled humidity 

A. temperature 

B. temper 

C. light 

. D. dampness 



^* negotiated the contract 

A. rewrote 

B. said no to 
C talked over 
D. signed 

26. the gavel pounded 

A. terrible headache 

B. wooden hammer 
C' bass drum 

U. heart 

27. obsolete automobile 

A. out-of-date 

B. very old 
C large 

D. worn-out 

28. modify the design 

A. photograph 

B. display 
C help with 
D. change 

29. automobiles depreciate 

A. lessen In value 

B. require care 

C. run on gasoline 

D. are necessary 

30. oppose her wishes 

A. talk about 

B. listen to 

C. act against 

D. ignore 



STOP HERE. 
END OF TEST. 



STUDENT FORMS 

STUDENT DATA FORM 
ATTENDANCE FORM 
ATTITUDE SCALE 



Name of Opertting Agency 
ProiKtIO 



Student 10 



nn 



STUDENT DATA FORM 
fitrt U (This section m be ampleted by studmt upon enrottment/ 



OMB #8t-S.730«3 
iitpIrM 7'i-74 



coram 

month €l»v yMr 



flrtt 



t Stcdtnt's NiiM 

mbotir 

4 Ethnidtv □ Black O White □ Spanish Sumtme □ Portuguese 

5 Highest Grede Completed fn U.S. Schools [ [ | 

6 Employment Status O employed more tfian □ employed less than 

20 hours per week 20 hours per week 

7 ReasOTS for tnroilment: 

C3 Counselor (teacher, parents, parole officer, etc.) said that I should enroll 
O Want to learn to read (or read better) in order to: 



2 Sex 



□ mate 
CD female 



O American Indian 
□ unemployed 



□ Asian O Other 
O full time student 



O d better in school (got better grades, advance 
to next level, get GED, etc) 

Q handle life situation better (read newspaper, 
drive car, help children with homework, etc«) 



O get a job (or better Job) 
O other (describe) 



Pa r t III (T h is sectio n to be completed by proiect staff upon enrolment J 

mmm 

month (tey year 



8 Date of EnroHment 



9 Mative Language □ English 
W 

Fluent in Spoken English 
STUDENTS INSTRUCTION PLAN 



It 



12 
13 
14 
IS 
16 



17 
18 



month ctey 
LANGUAGE AND REAPING DATA 



□ Spanish O Portuguese 
Able to Read Native Language (if not English) O Yes O Mo 

D Yes O No 



C3 Am. Indian O Chinese O Other 



D tutor 



Assigned to (cfwck one or botfif □ class 
timm of Regular Teacher or Tutor 
Teiwher or Tutor ID | | | | 
Number of Class or Tutoring Sessions Scheduled Per Week 
Nimiber of Hours of Attendance Scheduled Per Week \ \ | 



TERMINATION DATA (to be completed by project staff upon ^rmlnationl 

m m m 



mmm 

month cf»v v««r • 
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Dato , . . 

mSmh cf»v 

Reason ED withdrew 

□ moved 
CD health 

□ trar^portation 

O timo conflicts 

O child care 

O lack of interest/dtssatisf fed 

Q family 

□ fob change 
T unkaown 

D otner (dc'tjcfibe) ^— ^ 



Q dropped 

O non-attendance 
O discipline problem 
O other (deso-ibe) 



• V 

Q completed 

Of session ended 
/Q moved to more 
V advanced program 

O accomplishod personal 
goafs 

L3 otfier (djscrilie) 
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READING ATTITUDE SURVEY 
An attitude scale for Grades 7-12, College atudents, and Adults 

* * * 

This attitude scale has been developed to measure 
attitudes toward reading, including: attit.udes 
about reading as a useful or pleasurable activity, 
perceptions of self as a reader, and specific 
reading behaviors which reflect attitudinal factors. 



INSTRUCTIONS FOR ADMINISTRATION: 

Explain that this scale is a way for people to describe 
their real feelings, beliefs and actions in relation 
to reading. It is not a "test" and there are no right 
or wrong answers. 

Carefully explain the method for completing the survey 
form, as follov;s: "For each statement, place a check 
mark (✓) in the box v^hich bost describes how frequently 
you do, think, or fesl the tHIng which is described. 
Thus, the firsit item, item A, says 'I'd rather watch 
television than read.' Would you rather v;atch television 
than read VERY OFTEIJ? If so, place a check in the first 
box ( box a ) . Would you rather watch television than 
read OFTEN? Then check the second box ( box b ), etc." 
Repeat this sequence as often as necessary — for every 
item in the scale, if you wish — so that everyone will be 
able to complete the form correctly. Remember, we are 
interested in securing a true statement of attitudes, 
not a measure of reading or test-taking ability. 

Because this is not a reading test, every effort should 
be made to insure that every student understands every 
item. Methods to accomplish this include: 

(a) reading every item aloud, as many times 
as needed, and/or 

(b) translating the instructions and the items. into 
the student's native language, where completing 
the scale in English would create a handicap. 

When the scale is completed, ask each student to: 

(a) check it over to be certain that every item 
has been answered 

(b) bo nurc to \n\t their full name at the bottom 

(c) fill in the date. 



There is no tir^o limit. 
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READING ATTITUDE SURVEY 



(check one box for every itetn) 



1. Z*d rather watch television than road. 

2. X get really involved with the people 
X read about. 

3* X manage very well without reading. 

4. X think I'ar a good reader. 

5. Reading gives me interesting ideas about 
things to do. 

6. I re-road a story or article that I 
especially like. 

7. X spend my free time reading. 

8. If I wont to know something, I try to find 
a book or article on the subject. 

9. I like going to my reading class. 

10. lt*s hard to get the meaning out of things 
X read. 

11. I likf> to get books (or magazines or comic 
books}- for presents. 

12. I talk about the things I read. 

13. I get so involved in what I'm reading that 
X lose track of time. 

14. X can figure out words that I don't know. 

15. X feel discouraged ab«it learning to read well. 

16. X borrow books or magazines X want to read 
<£rom the library, teacher, friends or family). 

17. Reading becomes boring after an hour. 

18a I get really helpful infoxmation from reading. 

19« I think people who read well ^ave fuller lives 
than those who don^t read well* 

i 

20, Books are filled with interesting idoas. 



1. 


VER)f 
OFTEN 


OFTEN 


SOME- 
TIMES 


HARDLY 
]^ER 


2. 
3. 


1 ■ 






I I 


4. 






<»[Z] 




5. 










6. 
7. 










8. 
9. 










10. 


«□ 








11* 
12. 


aD 
«□ 








13. 
14. 
15. 


a| 1 


I — 1 






16. 
17. 
18. 


1 — 1 
a!_j 
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^ j 1 

»>i i 


CI 1 


( 1 

.1 — 1 


19. 
20. 
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21. 1 go to book stores (or book displays in 
other stores) to look at the books. 

22. I read just for fun. 

23. I think I'lX be able to get a good (or better) 
job vhen I can read better* 

24. I volunteer 'to read aloud (in class* to my 
family or friends) . 



25. Reading helps me to relax. 



21. 
22. 

23. 

24. 

25. 



VEUV 
.OFTKN 



(check QUO box for cvcrt j ite:n) 

SOME- HARDLY 
TIMES EVER 



« 



OFTEN 



a 
o 



□ 
□ 

□ 

□ 
□ 



dill 



d 
d 



□ 
□ 



Name 



last 



first 



Student ID 


— J , — , ... 

1 t t 

!.. » ! 




Project ID 


1 1 ' 

1 t 
t 1 . 




"V 

Date ] 


-. . , . 

1 ! 1 


month 


day year 



@ P.T.&T.A. 1973 
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STAFF FORMS 



STAFF DATA FORM 



STAFF QUESTIONNAIRE 



Name of Operating Agency 



M«io rm 



Stsff/Voluntsar iO 



on 



r llMiQof Staff Member , 



STAFFA^OLUNTEER DATA FORM 

^rtlt fTabecomplewdbya//$t9fftmmbm./ 

ffrtt 



OMB #61 8*73043 
Exptm 7-f-74 ^ 



2 Sex O male 
CD female 



m mm 

month d^v vMr 

4 Ettmicfty □ Black Q White □ Spanish Surname □ Portuguese □ Am. Indian □ Asian O Other 
EOUCATION 

5 Highest Year of School Completed | | [ 

6 Degrees O high school diploma O GED O AA □ bachelor's degree CD post-graduate degree O teaching credential 

□ other (describe) « 

7 Have Hmi Formal Courses in Reading Instruction? O none □ 1 -2 O 3 - 4 O more than 4 

EXPERIENCE r-i— i 

8 Number of Years Teaching m 

9 Number of Years of Other Relevant Experience | | | Describe: ' 



JOS ASSIGNMENT 



W Title O Project Director □ Asst IVoJect Director O Other Administrative 

CD Reading Specialist (□ Teacher CD Tutor/Aide {paidi CD Tutor/Aide (volunteer) 
O Counselor CD Clerical □ Other (describe) 



ft Date of Employment in R2R Program 
(for volunteer, date begun) 



1 1 


1 


! 1 




1 1 


month 





a 



t2 Number of R2R Working Hours Per Week 

13 Number of R2R Teaching Hours Per Week [ | [ 

LANGUAGE DATA 

14 Native Languasp □ English □ Spanish Q Portuguese 

CD Chinese CD Other 

15 Languages In Which you are Fluent (check all sppratH^fBtei fD English 

D American Indian language O Q\\ne» O Other 



CD American Indian language 
CD Spanish ID Portuguese 



16 
17 



TERMINATION DATA (to be completed by office upon termlnationt 



Owe 
Reason 



month tfay 

O dismiss^ 

CD absenteeism 

O lacking in skiifs 

CD interpersorai problems 

D other 



CD voluntarily left 

O personal reasons 

O dissatisfaction 

C3 othei employment 

CD unknown 

CD other ^ 
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STAFF QUESTIOHflAIRE 

Name of Project • Project ID # 



Pacific T. s T, A, is conducting an evaluation of the Coiranunity Based Right to Read 
Program. Since teachers and tutors are most directly knowledgable about the program's 
impact on students, we are requesting your assistance in analysing your program. 

The following questionnaire contains statements about the program. For each 
statonent, circle the response which most accurately reflects your opinion. Please be 
frank in your responses. No names are required and all answers will be treated 
confidentially. Thank you. 



STIU)NGLY STROKGLY 
AGREE AGREE DISAGREE DISAGREE 



JOmNISTRATZON AND ORGANIZATION 

1. The project is effectively administered. 

2. The staff gets along v;ell with administrators. 

3. The project's goals are clearly defined. 

4. The project's goals are realistic. 

5. Administrator {/supervisors are helpful to the staff. 

6. Administrators are responsive to the staff's needs. 

7. The project has correctly allocated its funds 
for staff, materials, and other 

expenses. 

8. The project serves those people who are 
moot in need of reading instruction. 

9. The project is doing everything possible to enable 
the students to attend regularly. 

10. The project is doing a good job in limiting the 
number of drop-outs. 

STAFF 

11. Training provided by the project has ijuproved the 
staff's skills in teaching reading, 

12. Staff has a clear understanding of wh^t is 
expected of then on the job. 

X3. Staff is enthusiastic about teaching reading to 
students. 

Staff is cfoncirally well satisfied with salaries 
and working conditicnp. 
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$TR0tI6LY STRONGLY 
AfiK^ AGREE DISAGREE DXSAGKEE 

15. Staff members get along well with each other. SA A D SD 

16. Instructional staff (teachers & tutors) have the 

needed skills to effectively teach reading. SA A D SD 

3.7. Vhe staff gets along well with the students, SA A. D SD 

STUDENTS 

18. Students will substantially improve their reading 

skills due to their participation in the project. SA A D SD 

19. Students have a positive attitude about 

participating in the project. SA A D SD 

20. Students feel that the reading instruction provided 

by the project is valuable. SA A D SD 

INSTRUCTIOKAL PROGRA>} 

21. The instructional program is effectively designed 

to eliminate the students' reading deficiencies. SA A D SD' 

22. The class and/or tutoring sessions are scheduled at 
times aiK3 places \;hich are convenient for the 

students. SA A D SD 

23. Teachers and/or tutors use specific reading 

objectives to guide instruction for each student. SA A D SD 

24. Staff have adequate diagnostic information on 

each student to identify reading deficiencies. SA A D SD 

25. Instructional approaches are consistent with 

students' needs. SA A D SD 

26. There is a sufficient quantity of reading materials 

for the students. SA A D SD 

27. The reading materials available are compatible 

with students* levels and 'interests. SA A D ' SD 

20. The general atmosphere of the project (e.g., order , 
pleasant cnvironmcnitr friendliness) is conducive 

to teaching reading. SA A D SD 
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29 • What factors to you £eel have contributed most to the success of the project? 



30* What changes or improvements would you recommend for the project? 



31 • Other comments: 



PROJECT FORMS 

1. INTERVIEW GUIDE 

2, ON-SITE OBSERVATION FORM 
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Instructional Observation Form 



a)PY AVAILABLE 



I. IDENTirVING INrOWI/kTIOIJ 



Project time 



Project ID » 



Program Unit/Center 



Teacher *£s/Tu tor's Name 



ZD # 



Observer 



IZ. LOCATION 

0 Public School Classroom 
College Classroom 
Center 

TutGe*s Home 
Tutor's Home 
Other : 



0 
0 
0 
0 
0 



Length of Observation Date of Observation 



III. NUMBER OF INSTRUCQX}RS 



Teachers 



Tutors 



Voluntcorr- 



A> Assigned 



TOTAL 



Be Present 



n> 
o 

n 

a 
Is 

^; 

a) 

ft 
o 



IV. NUMBER OP STUDEflTS; A. Enrolled 



m 



B. Present 



V. DURATION 07 SESSTON: A. Scheduled 



B. Actual 



t-i 

fT 

o 



p 

til 
o 



VI. FREQUSKCV OP CESSIOIJS: A. 



times per 



VII. PATTEKM OF INSTRUCTION (chfcck all appropriate and double check daninant pattern) 

00 
00 
00 
00 
00 



EKclusively ono-to-one tutoring 
Multiple tutor-tutee combinations in group setting 
Single group under direction of teachftr/tutor 
More than one group ^ v/ith one teacher*^ 



Multiple groups^ with multiple 
teachers/tutors 



f^ere grouping is used^ 
detail as follows « 



0 0 Other 



Group 



V 3 



Kuribor 
in group 



Led by 



Vcacher 



ind. 



O 

o 



rr 
O 



Vm. roUA OF instruction (chock aU appropriate 

0 0 "Lecture- format (little or no 
student participation 

Teacher-directed instruction, with 
active student participation 

0 0 Student (s) working independently 
with materials—teacher guiding or 
obsdrvin? 

0 0 Student (s) working along (little 
or no teacher involvement) 

0 0 Group process, with teacher as 
resource 

0 0 Group process, independent of 
teacher 

0 0 Other 



Ksaemmum 



and double check dominant form) 



SELECflOM 


INDIVIDUALXZATION | 


0 0 Teacher- 
selected 
"Materials 

00 Student- 
selected 
materials 


00l<3ontical 
materials for 
all 

00 Different 
materials for 
each individual 



IX. STYLE OP INSTJiUCTION (check one in each column) 
0 0 Traditional, formal n 0 

f>f^ U U Highly structured (in terms of 

U U Non-traditional, informal Program planning & sequence of 

activities 

0 0 L ittle evidence of planned soqwencc 



{J U .^SL (EnglisJi as second language—oral) 

° ° l:rT?oVs:Vj^^^^^ ^"-tuation, oral vocabulary, definitions, 

0 0 Motivational focus: Q Improved self-image 

0 Emphasis qn success in learning 



0 0 Developmental reading | 



(instruction, drill) 



0 0 Reading in content 
area: f-;hat? 
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METIfOD 



0 0 Systematic phonics 
or linguistics 
inherent in material 

0 0 Applied phonics 

(taught separately 
and applied to 
materials) 

0 0 Sight reading 
(clues, but no 
decoding) 

0 0 ^»prlr^tcd reading 
(no i-pocific 
"iotljod) 



LEVEL 



00 

88 



00 



00 



Reading readiness 

Decoding/ 
Word recognition 
0 0 dis'ple consonants 
0 0 complex " 
0 0 simple vot^els 
0 0 complex •» 

Structural analysis 
(compound words. 
Prefixes, suffixes, 
nyX3 ahl ob , t1 .let i cr.r. r/'» 

Co;;.prohcn.':jo:j 
0 0 word m(.<.«uncj 
0 0 sentence rAructnrf 
0 0 i^^ctii 

0 0 fitUdy ;:I.Ulr. 



i 



C. MATDRIM^ (cJicck all appiropriate and double check throe most frequently used) 
A. Typically Used 

0 0 Workbooks, skill books (Phonics We Use, Readers* 0 0 

Digest Skill Builders) 



Ex. 



0 0 Basal Reiiders (e.g., Scott Foresman) 

Ex. 



00 



0 0 Programmed Materials (e.g., Sullivan) 



Ex. 



0 0 Skill Kits re.g., Reading Attainment, SRA) 
Ex. 

0 0 High interest/low vocabulary 

Ex. 

00 Commercial games 

Ex> 

00 Audio-visual equipment 
Ex. 



Special tcchniguG materials (ITA, Xaubach, Words 
in Color) 



Ex. 



0 0 Books, paperbacks, magazines, nev/spapers 
Ex. 

0 0 Practical materials (signs, ads) 



Ex. 



0 0 Teacher-prepared materials 
Ex. 

0 0 Stu;lrnt.-xn-cr:M-o.I n.at orialj; 
Ex. ' 

0 0 Olh'. r: 



00 



00 



00 



00 



00 



00 



00 



00 



00 



00 



00 



00 
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1 XXI. MATERIALS RATING SCAI4^ 

Appropriateness of level 


Poor 
1 


Fair 
2 


Good 
3 


Excellent' 
4 


Quantity 


1 


2 


3 


4 


Interest 


I 


2 


3 


4 




• 


• * 


* 




XIZZ. TEACHER RATING SCALE 










Knowled9e o£ subject natter 


1 


2 


3 


4 


Classroom management skills 


1 


2 


3 


4 


Attitude (enthusiasm, rapport, 
expectations) 


1 


2 


3 


4 












XIV. CIASSROOM RATING SCALE 










Degree of individualization 


1 


2 


3 


4 


"Tone", atmosphere 


1 


2 


3 


4 


Level of student participation, 
interest, involvement 


1 


2 


3 


..f 



f 

I XV. CCXU2ENTS 



XVI. OVEr<ALL R;»TING (in terms of 

potciitial for students learning 

to read) 1 2 3 4 

Poor Pair Good Excellent 



PROJECT PROFILES 



The Pinal Report presented an overall discussion of 

?f student and adult projects. This 
f f JiS? ?! ^I^ appendix presents more detailed information on 
an individual project basis. Specifically, it provides a 
^^?«fT! profile for each project which discusles the target 
p^ulation, the service delivery system, findings from the 
on-site observations, and information on each project's parti- 
cipation in the evaluation, particularly as it relates tS 
variations from the standard design. rexaT:es zo 
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BEST GOPy AVAfUBLE 

PROJECT PBOFIXE 



^^^^ Py-ftift^t ft 1_ R2R BODGBTt ' •45>t)0t) 



TARGET POPULATIC^ 

CUMULATIVE ENROLLMENT: ' ' 71 -•' PREDOMINANT ETHNlClTYs Black 
PREDOMINANT AGE GROUPs eolleqe ESLs ' No 

Participation in the R2R program is a stipulation of 
university admission for students whose reading performance 
falls below required levels. Participants are almost entirely 
black, cpen admissions freshman students, whose Nelson-Denny 

Ir^®?hf^«5!^i5^ 2^ in reading or -high risk?^ 

from the standpoint of college requirements, (i.e., approxi- 
mately Jj scored between 5th and 9th grades &nd H scored at 10th 
grade and above. } 

SERVICE DELIVERY SYSTEM 

STRUCTURE: scheduled classes INSTRUCTIONAL STAFF: p^ld 
SCHOOL CREDIT: Yes LOCATION: College 



50 minute classes are offered at various times fcetween 
8 am and 4 pm, Monday through Thursday, and R2R students are 
required to attend two of these classes PLUS a 50 minute lab 
on Friday (for a total of three 50 minute sessions per week) 

elementary school or do 
independent study in lieu of regular class participation. In 
addition, all students have access to individual or small group 
tutorial assistance in needed subject areas,on a drop-in basis; 
?nd^.SdfnJ Providing multiple options (classes, laSi 

independent study, serving as tutors and/or receiving tutorial 
prwrgoi^s?"" improving reading skills is one of the program's 

ON-SITE OBSERVATION ; 

8 sessions, including 2 independent study students and 
one tutorial session were observed. The independent study 
students v/ere utilizing controlled readers to practice compre- 
hension, and the one-to-one tutoring session was also working 
Independently to practice comprehension. The 5 classes ranged 
in size from 5-8 students, with 3 teachers and ^u tors per 

ERIC 94 ^CJ^ 
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SriiaS^il^a^lonS^^^^o''^"^ independently under teacher guidance. 
wi?h 2^ t^^^ characterized as non- structured , 

li^ «F structured set of learning activities. The con- 

tent of instruction was exclusively developmental readina fo2«B4«« 

ProdMSn'l?cS?iSS^? "P^S- ^^terlKMJS^^ 
Ki?! Programmed Texts, Tactics II , Scott Poresman sklii 

4^ 5? 225?*'?'^® Guide to Effective Readies! DlvSiiD^ 

Ing Reading Efficiency, Free to Read and Study Skills ? 'a Itud-^ 
dent's Guide for Survival,also some practical Lterials. 

PARTICXPA TI<»? IN THE EVALUATION S 

The program is well organized and full compliance with 
^SS«?y;^l?f ^''J requirements was readily achieved; tSI Sn^y 
complication from the evaluator's standpoint was the dif f icultv 

JL*''*''^^''? attendance hours for the students enrolled in the ^ 
Independent study program. ^^o±xea xn tne 



Ksr cow mum 

' PROJECT PROFILE 
RAMEt ■ • Project B R2R BUDGET i 4S,Q{)a 



0 



TARGET POPULATION 

CUBfWMiTIVB BRROMJoENTr 535- *" PREDOMINANT ETHNlCITTr Black 
PREDOMINANT AGE GROUPi College ESLt No 

Participants are virtually all black college freshmen and 
sophomores (between the ages of 18^21) who are referred to the 
R2R program l>y the English Division when they are perceived to 
be inadequately prepared to take the regular college-level 
English course. This determination is based on test scores 
revealing reading grade equivalencies of fifth through ^linth 
grades • 

SERVICE DELIVERY SYSTEM ; 

STRUCTURES Schf>duled Classes INSTRUCTIONAL STAFF s paid 
SCHOOL CREDITt ^es LOCATION: college library 

K^^i/S!®®'^*'^^^^?' provides a pre-beginning-level college 
^glish course designed to upgrade reading skills. The program 
consists of 21 different classes, designated as English 101. 
Each class meets twice weekly, for 55 minutes per session (a 
total of 1 hour and 50 minutes per student per week) . Courses 
are offered on a quarter basis (i.e., 10 weeks per quarter) 
and students may participate for as many quarters as necessary, 
r*®^? are approximately 23 students per class, and each class 
is staffed by a professional instructor and two tutors. 



ON-SITE OBSERVATIONS 



Due to the operation of the program in two quarters, 
there were no regular classes available for observation durina 
our on-site visits. 
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PARTICIPATION' ly THE EVIkLUATIONt 



-.^ ^ enrollment figures and the fact 

that the evaluation period covered two quarters, the staff at 
Lawson did a really superb job of supplying needed evaluation 
data. Our data collection and handling was complicated by 
%he factor of two quarters (plus size} , but there were no 
insurmountable problems. 



' PR'PJEOr PROFILE 
NAME: Project C r2R BUDGETj ' 'AKVnhn 



TARGET POPUIATION 

Spanish- 

CUMDLATXVE ENROLLMENT: ' ' • SI PREDOMINANT ETHNICITY: surnamed 
PREDOMINANT AGE GROUP: COlleige ESL: No 

All are Chicano students enrolled at Project C state colleae 
and identified by EOP as students who would have difficulty in 
completinv the regular curriculum unless they receive special 
help, 

SERVICE DELIVERY SYSTEM 
Scheduled 

STRUCTURE: Classes INSTRUCTIONAL STAFF: Paid 



SCHOOL CREDIT: Yes LOCATION: college 



This is a self -contained intensive program—emcompassing 
college-level lectures and special small classes — for a period 
of hours each day. During the fall, students receive SH 

hours of lecture (3% in Humanities and 3 in Psychology) and 
spend the balance of their time in small classes, where reading 
instruction is applied to the readings and subject matter covefred 
in the lectures. In spring, the courses are Humanities and 
English. In both semesters r the students receive almost 10 
hours of remedial reading instruction per weiek, in addition to 
the normal lectures. The focus is on teachiing reading skills 
through the' subject matter of the lectures, since the state 
college system prohibits the giving of academic units for re- 
medial work* Lectures are given in the R2R building by regular 
collegeL-lnstructors \4iile sEoall class instruction is provided by 
advanced college students enqaloyed by R2R. Students take only 
one class outside the R2R program. 



ON-SITE OBSERVATION : 



Three classes were observed, with class sizes of 7, 12, 
and 27 students and 1-3 teacher (3) or tutor (s) per class. 
The first class was. the Humanities lecture portion of the 
project, which is basically the regular college course lecture 
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on this stxbject. This class was characterized as teacher 
directed, structured in organizational style and highly 
structured in terms o£ learning activities. The other two 
classes followed the lecture to provide help with this course. 
Multiple tutor/tutee groups were used to discuss the lecture. 
The form of instruction was teacher directed. The content of 
these two sessions included developmental reading and content 
area reading, with a primary focus on discussing facts, main 
ideas, & inferences as they related to the lecture. Materials 
included students' lecture notes and teacher prepared sheets 
on the lecture. 



PARTICIPATION IN THE EVALUATION t 

Because of the small numbers and the self-contained nature 
of the program, all aspects of the evaluation were completed 
easily and thoroughly. 
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PROJECT PROFILE 



NAHEs Prftj^t^ D R2R BUDGETt ' •4a/0t>a 



TARGET POPULATION 



CUMULATIVE ENROLLMENT: 72 PREDOMINANT ETHNICITYa White 
PREDOMINANT AGE GROUP* college ESLi No 

The program serves two distinct populations? The over- 
whelming majority are freshman students who voluntarily request 
assistance in speed reading and study skills ^ but are not below 
freshman ^reading performance norms. The second group is a very 
small number of Spanish sumamed adults living in the community 
who want to learn to speak and read English. 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Scheduled Classes INSTRUCTIONAL STAFF: Paid 

SCHOOL CREDIT: No . LOCATION: College 



The program has two separate components for the above 
population groups: The college component is organized in a 
continuing 7 week semester basis with students attending for 
as many semesters as they wish. Classes are held for 2 or 3 days 
a week , 1-1% hours per class ^ with approximately 10 students 
per class. The Result component is organized on a 14 week basis. 
Classes are held for 1 or 2 days a week t l%-3 hours, with 
ap:i.oximately 5 r.tudents per class. Instruction for both com- 
ponents is provJ'-'ed by the Project Director, 2 teachersfsnd 
2 paid tutors. 

ON-SITE OBgERVATION : 

Fotu: classes were observed, one for the ESL adults and 
three for the college students. Class size ranged from 3 to 13. 
The ESL class used teacher directed instruction, while the 
students in the college class ^^^orked independently under 
teachr. guidance. The ESL cIsll^ was characterized as structured 
in org^-^izational style with liti.^?^ evidence of a planned 
activities sequence. The ESL clas> ^onceritrated or. oral language, 
lanfjuago arts and some developmental . -^ading for reading readi- 
ness and word comf rehension. Materialb Included SRA skill kits 
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and Levine Vocabulary programmed texts. The college classes 
vere characterized as non-structured with a structured sequence 
of activities. The content primarily focused on speed reading, 
with some developmental reading and language arts. Materials 
included the Scimmer & Scanner workbook » EDL programmed text, 
the dictionary, control reader f ilmstrips, and teacher prepared 
ditto sheets. *^ *^ 



PARTICIPATION IN THE EVALUATION S 

Pre-testing did not occur until early February since the 
Program was on semester break during December. The pre-test 
scores for the college freshmen indicated an average reading 
level above 12th grade. Accordingly, it was decided to conduct 
post-testing only for the adult Spanish students, since no 
gains for the college students could be demonstrated on the SRA 
rest. 
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PROJECT PROFILE 
NAMES Project E r2r BUDGETt • • 45^/6 W 



TARGET POPUIATION 

CUMULATIVE ENROLLMENT: 99 PREDOMINANT ETHNICITY: White 

PREDOMINANT AGE GROUP: Jr/Sr.H,S . ESL: - ' • ND" 

The program in Stillwater serves a preponderance of junior 
and senior high school students (plus a very few adults and out- 
of -school teenagers) . in Ponca City, there is a small program 
for children who are residents in a hoiae for dependent children. 
All of the enrol lees are from low^income families f approximately 
3/4 are white, 1/4 are black* and a few are Native-Americans. 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Tutorials INSTRUCTIONAL STAFF: Paid 

SCHOOL CREDIT: No LOCATION: Centers 



The Stillwater Center is open from 3 to 9 pm every weekday 
during the school year, it is staffed by. a large number of 
tutors, who provide instruction to individual tutees on a 
scheduled one-to-one basis in the center setting. The Still- 
water tutors are generally Project E state University students, 
working imder the supervision of professionally trained, half- 
time supervisors. The Ponca Center is staffed by tutors, 
drawn fran the ccanmunity, who provide individual instruction at 
the home frcaa 4-8:30 pm twice a week. Each tutee (in both 
centers) attends two sessions per week, for one hour each, 
during the school year. 

ON-SITE OBSERVATION : 

Eight one-to-one tutorial sessions were observed, which 
were for the most part teacher directed. The organizational 
style was characterized as non- structured , with some sessions 
utilizing a highly structured set of learning activities and 
others indicating little evidence of planned activities. The 
content of instruction focused primarly on 'developmental read- 
ing and secondarily on language arts. The method for develop- 
mental reading included systematic phonics, applied phonics and 
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assisted reading, focusing on decoding, stxuctural analysis, 
and comprehension. Materials used included workbooks - Barbe 
Reading Skills Guide, Reading for Concepts, Bamell Loft? 
skill kits - SRA vocabulary! high interest low vocabulary books? 
other books and magazines > and teacher prepared sheets. 

PARTICIPATION IN THE EVALUATION S 

Project E complied fully with all of the evaluation 
requirements. In initial testing, it was found that some of 
the tutees were virtually illiterate and unable to cope with the 
blue form of the SRA; this situation was bandied by provision 
of the primary form of the SRA for these students. 
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BEST cow AVWIABIE 

* PROTECT PROF ILE ' 



MANEs Project F 



R2R .BDDGETi 5-a»1^aa 



TARGET POPULATION 



CUMULATIVE ENROLLMENT: 132 PREDOMINANT ETHNICITY, Black 

PREDOMINANT AGE GROUP: & Sr\ High ESLs No 

in ^^'^^^ ^ "^^^^ 5^"^® f^-^6> of black students 

^""^ 5®^"" Project F university, students are 

JSa^'^ftKyl^^^ "-^^ P"^"^' the 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Scheduled c lasses INSTRUCTIONAL STAFF: Paid 



SCHOOL CREDIT: No LOCATION: Schools & centers 

ho«r.«^J^^®^?^^^^® classes meet from 3-6 times a week tor 2-3 
?fSfL5 Class size ranges from 35 to 9 with 1 or 2 

teachers per class. All teachers utiliae -The Workshop Way" 
teaching method, originated at Project F,iAich is designed to 
emphasize individualized instruction in a classroom situation 
The program emphasizes its available special activities and 
HvS^^J^!!*''' ?^ basketball teams, mini-bike program) as incen- 
liltL^ regularly attend R2R classes. Special activities occur 

la^sVl^ir^f^^eldi^.^'^^^ - - '^'^'y -^«^«led 



ON-SITE OBSERVATION : 



Four classes were observed with class sizes of 7. 15 " 24 
h pattern of instruction included both single group 

under the direction of one teacher, more than one group with one 
teacher, and multiple groups with two teachers? In thi multiple 
group situations, teachers rotated from one group to another 
Class time ranged from 2-3 hours, including time for 

f ff^w 2?^^ f^^^'^^J®?-. instruction included 

teacher directed activities, independent work with teacher 
guidance, and group process activities. All four classes were 
characterized as nonrstructured in organizational style and hiqhlv 

^^^^^ sequence of activities. Program content ^ 
i2f i ? language arts and writing in one class, and develop- 
mental reading xn all four classes. Motivational support was 
also evidenced in three classes. Developmental reading methods 



incltiaed systematic phonics in all four classes, sight-reading 
in one class, and applied phonics in two classes. Developroental 
reading focused on all the four levels of reading readiness, 
decoding, structural analysis, and word meaning comprehension. 
A wide and varied range of materials were used including work- 
books—Modem Curriculum Press Phonics, Merril Reading Skill 
Text series. Phonics We Use, Bell & Howell Phonics? programmed 
materials— SRA Reading for Understanding; skill kits— Dimen- 
sions in Reading and SRA Skill. Kit? high interest, low vocabulary 
— Scope Reading Series; filmstrips and tapes; words in color; 
some books, and teacher and student prepared materials. This 
wide variety of usage is accomplished by having the students 
participate in as many as 10 distinct activities in one class 
session. 



PARTICIPATION IN THE EVALUATIO N; 

One of the centers was providing instruction to pre-schoolers. 
Since these children were not ready for the SRA test they were 
not included in the evaluation. 



\ 
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PROJECT PROFIUB 



NAMES Project 6 



R2R BUDGET J •j63vt20 



TARGET POPULATION 

CUMULATIVE ENROLLMENT: ^3 PREDOMINANT ETHNICITYi 

PREDOMINANT AGE GROUP j ffiLctfi sctool ESLs ' • Ye'S' ' 

When the evaluation was begun, the Project 6 R2R 
program was serving Chicano students at Cooper Jr. High and 
non-English speaking adults. Subsequently, the Cooper program 
was discontinued and replaced by a program for Chicano students 
at Proeble High School. The adult program continued until 
April, but was terminated prior to post-testing. The evalua- 
tion, therefore, included complete data on the Chicano high 
school students at Proeble, and partial data on the adults- 
all of whom came from Mexico and never attended an 
American school. 

SERVICE DELIVERY SYSTEM 

STRUCTURES scheduled classes INSTRUCTIONAL STAFF: Paid 

SCHOOL CREDIT: Yes " " LOCATION: High school 

1) Proeble: The program consists of 5 classes tauaht bv 
teachers and tutors. Students with reading problems 
attend these classes in lieu of study-hall. The program thus 
provides one additional instructional period (40 minutes daily 
or 3H hours weekly), in the course of the normal school dav* 
for students with special needs. 

2. Adult: Instruction was provided by one teacher and 10 
volunteer tutors, working in small: groups, for 3 hours daily— 
a total of* 15 instructional hours per student per week. 

ON-SITE OBSERVATION : 

One high school class was observed with 20 students 
and 7 teachers and tutors. Multiple groups of students and 
tutors were used and for the most part students worked inde- 
pendently. The organizational style was characterized as non- 
structured with little pre-planning of learning activities In 
evidence. The content of instruction focused on ESL, language 

io6-^gc^a7f 
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Se^asafftfrri^STr*'*^?!^^^^' ^""^ developmental reading, 
tne assisted reading method was used for word meanlno a«5 

D^fl f^^^^^S*^- Materials used iSolJS^ TS^her pr|!^" 

pared manual, word games, and workbooks. ^eacner pre- 



PARTICIPATION IN THE EV3VLPATIQN» 



dc^c^^^^J^eltati^tfrSht^e'lrSv?!^ °" Participants, but 



CUMULATIVE ENROLUffiNTj 119 PREDOMINANT ETHNICITY: Made 

PREDOMINANT AGE GROUPi school ESLs yp 

J?®^^*^?^^^ serves 9th grade students who have been Identl- 
skills SS^fi ?»? counselors as deficient in reading 

skills. WhUe the school is the only 9th grade school in the 
community (serving a widely diverse group if studen?sK all 
participants in the R2R program are black. / axx 

SERVICE DELIVERy SYSTEM 

STRUCTURES Scheduled Classes INSTRUCTIONAL STAFF: Paid 

SCHOOL CREDIT: Yes LOCATION: School 



The grantee is Project H university ' , but the orooram 
operated at a public school by school p^son^elT 
^ffn^-^^"^ program consists of 6 classes held beforl school (at 
lii «^ minutes per session, 5 days a week. Classes 

are smaller than those of the regular school (averaging 12 stu- 
f52?f^P®'','=^*^l ^""^ regular school ficulty (wi?h 

a ftJoSfJ^L^SS ""^^ ^^""^ the stSSents receive 

a stipend of $1.00 per session, in addition to school credit, 
for participating in the program. The original design (imple- 
thf «fu^S^i"^ ^^t f^^^tf^ P'^i^'^ to the evaluation stSdy) Utilized 
r^f/^*'"^'*^^ °^ younger children; this portion of the 
^"^^^^^ f®^®^ successful bi the director) was discon- 
culties semester under study because of funding diffi- 

^1,4 o ^^^^^^"^ f*f?*^ 2^.?^® program is the remedial reading lab - 
this is comprised of five classes per day, taught by one teacher 

tLV"^ S'^K^fu^^ *!:^ f^^^^ ^^^^^ day.^'The teacher is rIgSiarly 
employed by the school and students enroll as they would Jn^"''*'^^^ 

^?ed1n\olh^thf hL;^!?^ / Of s?SdeS?s pi?tici. 

patea in both the bef ore-school classes and the lab. 

One special feature was an intensive program of in-service 

??Iinf^ rL^'^f ^^t f^^^^ty, focusing particularly on the motiva- 
tional aspects of learning. 
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OW^SlTg OBSERVATION S 

Three classes were observed, with sizes of 6, 9, & lo 
students and one or two teachers per class. Single group, 
teacher directed instruction was used in two classes, and in 
the third the students worked independently. The organizational 
style was characterized as structured and highly structured 
ill terms of the sequence of learning activities* The content 
of instruction focused on language arts and developmental read- 
ing. For developmental reading, the assisted reading method 
was used focusing on word meaning, structural analysis, and 
con^rehension. Materials included Scholastic Magazine, "Whose 
Side Are You On* programmed text, and high interest-low vocabu- 
lary books including "Nigger," "on the Spot," and teacher pre- 
pared materials. 



PARTICIPATION IN THg EVALUATION S 

When the evaluation began, the program was operating on funds 
carried over from the previous year. When these were exhausted and 
no added funds were approved by National R2R, the program was 
discontinued. After a lapse of over two months, the new 
budget was approved and the program was begun anew. It was, 
nowever, difficult to re- involve many of the previous students, 
so a large number of new students were enrolled. During this 

further hampered by the extreme darkness 
af 7«30 am .in the winter months. All of this produced a 
serious discontinuity in the evaluation process and an unusually 
short pre-post test interval for the sizable number of new 
enrollees in the reconstituted program. Little data was provided 
on the lab students and they are not included in the evaluation 
study • 



PROJECT PROFILE 

• ••<• ••«• •••• ««•• •••• m m » m •••• ■ ■ » » 

NMIEs Project I R2R BUDGETS $50,000 



TARGET POPULATION 

CUMULATIVE EtvtlOLLMENT: 120 PREDOMINANT ETHNICITY s Biaek 

^ Jr. & Sr. 

PREDOMINANT AGE GROUP: BjqR ELSs NO 

The program serves high school students and drop-outs who 
are recruited from the local neighborhood Youth Corps, Job Corps, 
Employment Service and Snyder High School. 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Scheduled classes INSTRUCTIONAL STAFF: Pd & vol. 
SCHOOL CREDIT: No LOCATICMJ: College 



Classes are organized according to the four recruitment 
sources and meet at varying times and frequencies ranging from 
one day a week for five hours to four days a week for one and 
one half hours. Instruction is provided by the paid staff, 
graduate assistants and volunteer tutors. Team teaching is used 
with 1-2 teachers and 1-2 tutors and approximately 12 students. 
Instruction is individualized based upon initial diagnoses and 
the use of student self -selected materials. All materials are 
indexed according to reading levels so that appropriate materials 
can be used. The program capitalizes on the services of the 
work/study graduate assistants and the s^vailable facilities and 
services of the college. 



ON-SITE OBSERVATION : 

Seven classes were observed, with class sizes ranging from 
10 to 1 students. Multiple groups with multiple teachers and 
tutors were the primary units of instruction, with 2-4 teachers/ 
tutors per class. The form of instruction in most classes was 
independent work by students with the staff guiding and observ- 
ing. The style of instruction was cheuractcrizfid in all cases 
as non-structured in organizational terns and highly structured 
in terras of the sequence of flctivitios. The primary content of 
instruction was Gevtlopmental reading, with sowo language arts. 
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Developmental reading vms primarily util-^zed, along with 
assisted reading r focusing at various levels from reading readi- 
ness to comprehension. Materials include the Xerox Reading 
Success Series, Scope Sprit Series, EDI Kit, Phonics We Use, 
Specific Skill Series, as veil as some audio visual equipment 
and teacher-{>repared forms. 

PARTICIPATION IN THE EVALUATION ; 

The program presented no specific difficulties in partici- 
pating in the evaluation procedures. However, the high termina- 
tion rates resulted in a small sample of available pre/post tests. 
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^^'^^ ; Project J R2R BUDGET: ' ' • ^,tm7 



yRRgET POPULATION 

CUMUIATIVE ENROLLMENTS 32 PREDOMINANT ETHNICITY? 

PREDOMINANT AGE GROUPs High SGhOOl ESLs No 

The program serves Chicano high school students livino in 
Brownsville who seek a higher education. ^ 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Scheduled classes INSTRUCTIONAL STAFF: paid 
SCHOOL CREDIT: No LOCATION: center 



There are two basic classes which split up into smaller 
groups. Classes meet four evenings a week for 2-2% hours. 

fS^^'US! »!!«4f J'^SY^^®? reading specialists, with support 

from the Project Director and tutors. The classes are divided 
into two components: reading instruction? and enrichment, 

personal counselling, Chicano culture, career planning, 
etc. The program has a strong cultural and community partici- 
pat ion thrust as evidenced by fund-raising activities, field 
trips, theatre group, parents advisory council, supportive services 
such as eye exams, and is geared toward motivating students to 
go to college. 



ON-SITE OBSERVATION: 
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e Pj^f^fi^all ^roup sessions were observed, with sizes of 2, 
3, 5, and 14 students, with the core class splitting up into 

smaller groups. Instruction for each group was pro- 
vided by one teacher or tutor. The small group instruction 
included teacher directed and independent student working 
patterns, and a group process for the larger class. Classes 
were characterized as structured in organizational style and 
highly stxructured in terms of the sequence of activities 
The content of instruction included ESL, language arts, develop- 
mental reading and motivational support. The developmental 
reading utilized systematic and applied phonics methods 
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focusing primarily on word meaning ^ facts # inferences and 
study skills comprehension. Materials were primarily the 
Barnell Loft "Getting the Facts'* workbook » and additionally 
some student prepared essays f the dietionary^and a film on 
Mexico. 



PARTICIPATION ly THE EVM.UATION S 

The program had no unique problems in participating in 
the evaluation. 
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PROJECT PROFILE 
UAMBj Project k r2r BUDGETt • 35,000 



TARGET POPUIATION 

CUMULATIVE ENROLI^IENT: 123 PREDOMINANT ETHNICITY: Black 

High 

PREDOMINANT AGE GROUP: Schod ESL: No 

The program primarily serves high school students in the 
conununity who are referred from the Upward Bound Program (which 
Project K also operates) and Girls High School, Additionally, 
services are provided to a small number of black adults from 
the communit:y. 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Class & tutorial INSTRUCTIONAL STAFF Pd & vol. 
SCHOOL CREDIT: No LOCATION: Center 
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The above target groups are provided instruction either 
through small group or individual tutorials. The Upward Bound 
students meet in groups of 3, and attend one class a week for 
one hour per class. The high school students meet in groups 
of 8, and attend 2 classes a week for XH hours per class. Both 
of these groups receive instruction from paid work/study tutors. 
The adult coii5>onent meets twice a week for 1% hours per session 
and receive individual tutoring from tutors and the Project 
Director, The program is integrated into other Project K 
efforts such as Upward Bound and is able to provide Project K 
services and utilize its resotirces and community contacts. 

ON-SITE OBSERVATION 

Five sessions were observed, 3 of which were small group 
instruction with 2 students and 1 tutor ^ and 2 of which were 
individual tutorials. The sessions lasted from 1-1% hours. 
The instruction in all cases was teacher directed, non- «?tructured 

in organizational style and structured in terms of the sequence 
of activities. The content of instruction includod language 
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arts and developmental reading. The method for developmental 
reading was assisted reading focusing on the level of struc- 
tural analysis and word meaning, fact and inference compre- 
hension. Materials used included SRA Skill Kits, Getting It 
Together Kit, the dictionary, a drivers manual, and the 
Cambridge GED. 



PARTICIPATION IN THE EVALUATION 



Only 8 adults were enrolled in the adult component, and 
several terminated during the evaluation period. Accordingly, 
pre/post analysis was not feasible for this coioponent. 



PROJECy PROFILE 
HAMEi Project L r2R BUDGET j ' ' 3a, 00 a 



TARGET POPUIATION 

CUMULATIVE ENROIJLMENTs 150 PREDOMINANT ETHNICITY j White 
PREDOMINANT AGE GROUP: S&hQol ESLt No 

The program serves students in the two local high schools 
who are deficient in reading skills. These students are iden- 
tified and referred to the program by the schools' teachers and 
counsellors. 

SERVICE DELrvTERY SYSTEM 

STRUCTURE; Scheduled classes INSTRUCTIONAL STAFF: Paid 



SCHOOL CREDITS Yes LOCATION: High school 

The program operates out of the two high schools and is 
integrated into the regular school curriculum and process. 
Each school operates 5 separate classes daily for 55 minutes. 
Instruction is provided by one regular staff member at each 
school, with approximately 15 students in each clasB. 



ON-SITE OBSERVATION: 



aVK> of the regularly scheduled daily classes were observed. 
Both classes lasted 55 minutes with 8 to 13 students in atten- 
dance. Single group instruction under the direction of one 
teacher was used in both cases. The form of instruction for 
one clrss was teacher directed, while the other used independent 
work with teacher guidance. One class was characterized as 
structured and the other as non- structured in organizational 
style. Both classes utilized a structured sequence of activities. 
Language arts content was stressed in both classes, and one also 
had developmental reading using sight-reading focused on com- 
prehension. 



page 2 



Materials used included Double Action Short Stories and 
crossword Puzzles. The class which stressed language arts had 
student dramatic skits that particular day, which i^s an 
exception to the normal activities. 

I 

PARTICIPATIi^ IN THE EVALUATION 

The program had no special problems in participating in 
the evaluation process. «- ^ 



t 
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PRgjECT PROFILE 
KAtlEs Project M 




R2R BDIKSETj 44,336 



TARGET POPULATION 

COMULATIVE ENROLLMENT: 91 PREDOMINANT ETHN ■ t l^t 

PREDOMINANT AGE GROUP: ^i ESL: Yes 

Participants include both elementary anSlU sctooJ^Ste: 
SERVICE DELIVERY SYSTEM 

STRUCTURE: gg^l^'^^l^^clasp INSTRUCTIONAL STAFF: Pd. tutors 
SCHOOL CREDIT: students oAlv' LOCATION: High school 

4.U ^^f^^®?** tutors from Project M college work with 

the participating elementary and high school students for Ik ' 

^rAi^ K'si.r.K^ 'K^i^Sffi -2.1., 

ITtr^ f ^^T^'i"^'^ °«"» «»«»'^ with a smSu «ottp 

ON-SITE OBSERVATION : 

1*^2® group sessions were observed with class siz^^a i 

iLaf .JLf P^^^ insSuctll in thi ?wo ' 

large classes and one paid tutor instructed. in ^ 

Single group instruction was us^ in the SaU clasf aid 

niultlplo groupr, v.ore usrd in the two largrclasses wiS on. 
tutor assigned to each group. In all casL ficz^i^^*-^ 
teacher dirnn-rc^ ntK« ^i ^„f:l , cases, the instruction xrus 

ESL instruction, language arts, and developmentSi reacting! 

"8 «isir 
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The method for development reading was assisted reading focus- 
ing on the comprehension level. Materials used included Reader's 
Digest Workbooks, SRA Skill Klt£, commercial games, high interest / 
low voc«a>ulary books, newspapers, and teacher prepared materials. 

PARTICIPATION IN THE EVALUATION t 

The program was fully responsive to all evaluation reouire- 
ments. The only problem encountered was the fact that the form 
of the SRA test which was originally sent was too difficult for 
some of the students; this was remedied through provision of 
the primary form of the SRA. 
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PROJECT PR0PII,R 
£E2lSSiiL R2R BUDGET. 28.000 



TARGET POPXIIATIOM 

COMOLAIIVE ENROLUffiNT: 55 PREDOMINANT ETHNICITY. White 

PREDOMINANT AGE GROUP: Adults ESt. rq 

Of ageV™""'pfr««?„f?*°"*"''*:*'=««">l population, 14 years 
P^Sbi^^^^Sr^.S^^aT'"'"'"'"' attendance is.L^^t ■ 

m 

SERVICE DELIVERY SYSTEM 

scheduled classes INSTRUCTIONAL STAPP, pald 
SCHOOL CREDIT. _No LOCATION. Bug, nuilceshlft ..n..» 

Eight evening classes are offered at eloht^ d4f<r«--.«4. i 
tions (two classes each for four evenlnas wl^h f«f 

^„^°rs'L»S^^?ea^^^%- ^^^^ 

ON-SITE ODSL'RVATIO?I i 

one t^T^^s?^^:„%%The^S1^ 

Jl 2 0 

ERIC BEST COPY AVAfUBtE 



W8 Characterized as noS-lg^S??"!?- S?h"'f?;?J"'*»''"l "Vie 
of learning activities. The contm* f*'"? PM-Pl«nning 
developmental reading! uslna S2 !? - instruction ai£ed at 
Ing and conprehenslol Ma?Ll??,'* ""f^ns method for decod- 
Mott Basic Language Skills P^MrL * included workbooks- 
eeriesj Scott Porlanan Basal SlfSi.""^^* Specific Skill 

•na teacher preparS^h^ls^ ^^ker and SRA Skill Kits, 




complfJSf'^^ evaluation requirements was prompt and 



' ^HOJECT PROFILE 
Project 0 R2R BUDGETt SO, OOP 



TARGET POPULATION 

COHDIATIVE EtOtOmaiT, 121.. PHEDOMISAOT ETHNlCm. 
PREDOMINAHT AGE 6R00P. adulta ESt. Y»8 

most 2f"„gSS'SS "'Sjo^IfSff 
instruction. »eS%'SSI i?e°i;ieS2^^i|%\|5[L^^^^^^^^^ 
SERVICE DELIVERY SYS'TTM 

STKICTOREi Class«.ttatoK<.,. IMSTROCTIOSRL STAFF: _p«ia 



SCHOOL CREDIT: No lOCATIOK: 3 coM,uni.v 

«l««re'^oS|2?'1forX"nSJfKi«w«5*!" organized to serve the 
languale il sireSsed pricrto'relSlMil?? students, oral 
classes of 4-6 students nLt 2ff »r2L ""'™S4°"- Small 
per class. InstructioS "rDrfCLp^Kf Ju"*"!^ 

For the reading coSpoSent! iSdl^^^^.tJ^J"* f"^*''* Directors, 
paid college titorsrS-S tiaSs a S^J tt^lt't J" P"^'»'"ed by 
prograis exclusively utilizes the fifiLX f ^^■2^'»o«"- The 
methods tor oral reiidVi^^ll^.'"^ ""^^^ 

ON-SITE OBSERyATIOM i 

«d one'laS^idulity'rllSeslSd ""^ ""^^ts 

The sessions lasted^ ^% to 2 Sonr^'o?!S^f°\**'* observed, 
by paid tutors and the te2chlnl 8?2ff ' Th» J?'""»=tl<»> Provided 
in all cases was teachac dlreSted wiih l^t, instruction 
tion. The organizatioMl strte^s ctarfof«^?,fS"''*"* P-rtlcipa- 
tured and structured in tlSS%rihS't^^?ce'lf «tffi^"- 
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The content of instruction included ESL^using the "Silent 
way" method, and Developmental reading, primarily focused at the 
iS22^L?S:**^"?S^ level, with limited^^Loding Ld cS^^ehensSS 
iSd'liS^? V-tai! ^^^'^"•ively utilized the WorSs in Color 



PARTICIPATION THE EVALUATION t 



^ ^ At the inception of the evaluation, 55 students were 

fS^StiSfJ P^®-Jested» However, most of these students 

^fS^J^S^^S'^^®"',^® ^? P®®^ period. New students were 
recruited to replace them, most of whom enrolled in the Sprino. 
which was too late for pre/post testing. Accordingly, onl? a 
small number of students were available for pre/post testing. 



PROJECT PROFILE 
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Project P R2R BUDGETS $50,000 



TARGET POPULATION 

CUMULATIVE ENROLLMENT: 227 PREDOMINANT ETHNICITY' 

PREDOMINANT AGE GROUP $ Adults eSLj Yes 



The program serves Spanish surnaraed adults from the wafih4n«4.«,, 
SERVICE DELIVERY SYSTEM 

STRUCTURE: Scheduled c lasses INSTRUCTIONAL STAFF i Paid 
SCHOOL CREDIT: No LOCATION: Center 



The program offers intensive daily instruction. There 
are 7 separate classes, which meet 5 diys a week fSr 3 hoSrs 

^'^^ "^^^'^i"^ and 5 are iS the eSen- 

^2!:h«n^iJ^^''^®''^*''® certified and each class has Sne 

JnJo ? i^"^,^^^^*'?^!;!?®^^ 20 students. The classes are separated 

iSs?ruci?on fnf i^^ff^^?^^^ ''^^^ ^ 2 emphasizing o?a? 

e^DA^to^ ^^""^^l emphasizing reading. Students Ire 

expected to progress to a new level every 8 weeks Th** n^o^^I™ k-« 



ON-SITE OBSERVATIQM ; 



?® Classes were observed with one teacher per class and 
ranging from 15 to 5. The classes lasted 3 hoSs 
fLf^^ f?®®® ^^l pattern was single groups, teacher directed 
instruction. The organizational style wL'charaS?Lize5 as 
f^f?5f?ff? Sk structured in terms of the sequence of 

S^Jtll rlldina SSf »2^k^ instruction included ESL and develop- 
Sf«h?\.ff57« ^^^"^ f<>r developmental reading was primarily 

?e?el assfaSLnr'^^MrL f"/*^^^"^ ^^^^^^ depending Spon thi c?Iss 
level assignment. Materials were teacher-prepared sheets . func- 
tional materials, Cridler picture cards,and American fSiktflSs. 

PAR TICIPATION IN TH E EVAmATTnw 

evalultio^''^*'^"' ""^ special problems in participating in the 
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TARGET POPULATION 

CUMtJLATIVB ENROLLMENT: 72 PREDOMINANT ETHNICITY t 

PREDOMINANT AGE GROUP: Adults ESL: Yes 

4.!J!L?'^°^^*? serves Navajo Indians living on the reservation. 
The target population must be recognized as an extremely Impov- 

culturally Isolated coinSunlty that is vastly different 
from the dominant white culture. Most 5f the people live on 
hfi limited or no income producing skills and have 

had little or no opportunity to learn the English language. • 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Scheduled classes INSTRUCTIONAL STAFF: Paid 
SCHOOL CREDIT: LOCATION: 6 centers 

fikllirLSr!e*S4?J!^*'*^JfK? development ot income producing 
sKills such as silversmi thing,, and the use of practical cfurrl- 
culum such as drivers' education? and attempts are made to S^rate 
reading instruction with theee curricula. The program bv^^^ 

fhf ^LU??*' ^® flexible to accomodate the circumstances 

of the enrollees; e.g., attendance is extremely low in the 
winter due to weather conditions and at other times during the 

??asses are attending R2S c?Isses. 

^ -hogans- located throughout the reserva- 
tz^^L Classes meet once or twice a week for approximately 5-7 
Dsr cl!S *'^?nf;.„of?^^ ^^^^ 4.l2'^gith™riealher 
S2riAst^SltS?s!'°" ^"^'^^ 

ON-SITE OBSERVATION : 

Four classes were observed with class sizes of 2 or 3 
students. Instruction was provided in a single group settincr 
under the direction of one teacher. The form included student 
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Independent work and teacher directed instruction. The 

characterized as non-structured , with 
2 Classes having a structured sequence of activities and 2 

planned sequence. Content included oral ESL, lanauaoe 
arts, developmental reading, and motivational support. De^lSp? 
«S jLffffi''^ "^f^^^!^ systematic and applied phonics, sight 
??f assisted reading focusing on the range of levels fiom head- 
ing readiness to comprehension. Materials included teachers 

K^?f«ffo''°?^^'*}2''^.''*''**?' drivers' education manuals, and "A 
Professional Guide for the Lay Tutor" workbook. 

PARTICIPATION IN THE EVALUATION t 

The program fully participated in the evaluation. However 
imiSUf^ Navajo population represents a 

economically disadvantaged 

afSsS 2;^. °^ * program such 

as R2R must be viewed in terms of the vastly complex and 

Na^ljfplpSSI^ion.^^"^^''^''''*^ ^""^^^^ problems faced by the 
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TARGET POPULATION 

CUMULATIVE ENROLLMENT: 136 PREDOMINANT ETHNICITY: 

PREDOMINANT AGE GROUP: AdttXts ESL: Yes 

«^«i4.«**f»,^^°^^*?,f?^^®® Chicanes and other Spanish surnamed 
adults who are illiterate in English and/or Spanish. 

SERVICE DELIVERY SYSTEM 

STRUCTURE; Class & tutorials INSTRUCTIONAL STAFF: Pd. & vol. 
SCHOOL CREDIT: •-Nq--- • LOCATION: 3 Centers & hom^« 

The program has two basic components. The first is for 

instructfon^^r^h''^ ^^^S^*^? ^? ^^^^ ^"^^^^^^ CllssJooi; 
instruction for these students is provided 4 times a week for 

Fq?T It'' ""^^^^^ ^^^^^ approximately lS wi?h one 

ESL teacher per class. Individual tuto-ing is provided for those 
students who need remedial reading. The tutor iLusessionE 
vary substantially in terms of ti£e and frequent. Ilierallv 

o^r ItiTrT^'' JU^^" twice Tw2S"forT£ourr 

Denvir PnS?I. ^^he program is highly integrated with other 

rIsoScef of%hf ^^'"^^^^ facilities and 

ON-SITE OBSERVATION S 

Two ESL classes were observed. (No tutoring sessions were 
observed) . Instruction was provided by the ESL teacher for a 

i^?uL2?«"^ S^S ^ tutor for a sing?e group of 

5 students. Both classes met for 1 hour. Instruction was 
teacher directed and characterized as structured in oraaniza- 

con?^i/^?^L^i^^^ structured sequence of activitIes?^TSe 
content of both classes was primarily oral ESL, with some 

Developmental reading utilized the 
assisted reading method focusing on simple word r-coanition 

?odaf f^^^h^^J ^"^^y^?-^- Materials included the English For 
bl kb d "magazine pictures, and words vnritten on the 
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PARTICIPATION TN THE EVALUATION ; 

This program underwent substantial organizational and 
procedural changes as a result of its participation in the 
evaluation. Initially, the program's major thrust was the 
one-to-one tutoring component. However, the initial pre- 
test on-site visit revealed that many df the tutors and tutees, 
once enrolled .actually were not meeting regularly. As indicated 
by the Project Director, "The recognition of this very basic 
flaw . . . may well reverse the impact of the program." As 
a result of this finding, the program revised Its staffing pat- 
tern. Pour community representatives, who were supposed to 
train tutors and coordinate tutor/tutee contact, were replaced 
by part-time reading specialists who will supervise and coor- 
dinate a case load of tutors/tutees . The project coordinator 
was replaced by a coordinator who specializes in reading. 

A more realistic analysis of the project by the staff thus 
revealed that many of the tutors and tutees were no longer 
really in the prc-gram and thus were terminated. The high 
termination rates were the result of limited project control 
and organization and the expected transient nature of the ' 
population. From the evaluative perspective, this resulted in 
a very limited nunter of available pre/post tests only from the 
ESL classes and a very high termination rate. 
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PROJECT PROFILE 



NAME: 



Project S 



R2R BUDGETS 50/000 



TARGET POPULATION 

CUMULATIVE ENROLLMENT: 46 PREDOMINANT ETHNICITY: Mixed 

PREDOMINANT AGE GROUP: Adults ESLs No 



p««T^l!® P'^°?f^ serves low-inccane minority, white, and non- 
English speaking adults from the metropolitan Cambridge a?ea. 

SERVICE DELIVERY SYSTEM ; 

STRUCTURE: Tutorial s & classes INSTRUCTIONAL STAFF: pd.&'ypl. 
SCHOOL CREDIT: No LOCATioN: center & homes 



^r.A 4 5f P"9ram is individualized utilizing small group classes 
fr^«i"^^''^?''?i tutorials. Classes and tuto?ing seslions are 
arranged at the convenience of teachers and students TvoiLllv 
however, the classes meet twice a week for 2 hSu^s p;r class ^' 

i?\^.^f**=^®''® P®'' ^'^^ss of 4 students. Tutoring sessions 
which take place at homes or at the cenier, t?plcllly Ire 
scheduled twice a week for 1-2 hours per session tL?^L 

P"^'^^ ins?r5ct?oL'^?he*'progrSS e^^^^ 
sizes its non-structured and community oriented ^ 

^"'^ concentrates on the respective 
^^2" students. There is a strong 
emphasis on teacher and tutor training which is provided Uhrough 
continuous pre-service training cycles. f^wvioea ^nrougn 

ON-SITE OBSERVATION : 

tutor iaL®«n5^?5If wjre observed. Five of them were one-to-one 
rl! fiS^® a student doing independent work f o,- 

^^l ^ sessions lasted for one hour with ISr^tioS 

fn«^^.^^ volunteers and paid staff. Teacher dSecteS 
instruction was used at 4 of the sessions, with the fifth 
a game of scrabble. The organizationarsty?e was^chfrfcte??^od 
as non-Gtructured and structured in terms of tha sequoncc of 
activities. The cont;ent included language arts and dovelon° 
mental reading and math iti one session. Developmental reading 
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utilized assisted reading primarily and systematic phonics in 
one instance, focusing primarily on the word meaning compre- 
hension level. Materials included teacher prepared papers, 
the Trouble Shooter workbook^ and homework papers, 

PARTICIPATION IN THE EVALUATION t 

The Project s program has two major components, and only 
the direct instructional component was evaluated. The other 
component trains teachers from other agencies in the teaching 
of reading. Continuous training cycles are held for these 
agency personnel who after the training are supposed to be 
able to upgrade their current teaching performance. A sub- 
stantial portion of Project S's resources are utilized for 
this component and thus cost/student performance measures must 
be considered with this in mind. 
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PROJECT PROFILE 

NAME J Project T 



R2R BUDGETS ia/OOO 



TARGET POPULATION 

CUMULATIVE ENROLLMENT: 53 PREDOMINANT ETHNICITY: 

PREDOMINANT AGE GROUP: Adults ESL: No 

as migrant ^fann worTers. "^^^"^"^^^^ ^"^^^ full-time jobs, generally 
SERVICE DELmSRY S YST^ 

STRUCTURE: Tutorials INSTRUCTIONAL STAFF; Paid 

SCHOOL CREDIT: No_ LOCATION: center 

all stuIeSSL''^$hf l2R^S?oaL«"^ ^^^^^^ ^^^^^^ 

7 program has two major facets: 1) One 1« 

^^ii?ia^iS?»^"^^?"°"/~ studentf^afitlfied as 

f^ISi remedial reading when they come in for GED tutorino 
program. Full and part-time instruotorsT bo?h pro! 
fessionals and para-professionals employed bv the UniversffS 
staff the center from 8 am to 9 pm daily (except PridwwheA 
5^^°?"'?^ fi°^** "The instructors tuto? all thS^e wto 

S2» ? .f-S students) for as long as they wish? 

t5*«r<ff matching of tutors and tutees and^aU ' 

tutorial sessions are unscheduled. There is considerabio 
tlon in the number of sessions and hours studlStrfttSd 

per Sle^"'"** "^^"^ of %^^?Sof per'^kudeSt 

ABE a^ El?''ini*^.,S5r"?® coordinating services for all of the 
S?gan2^aUonarStS?l^ ^^^^'^ "^"""^ an »„„breul» 



ERIC 



131 



page 2 



both tl2^heTSf^lkT±"U^|^^^^^ used 
the sessions were characterized as non-stnStnrS " 

LVSSf a%U°??L"^^^^^^^^ P uSif ter»s of the ' 

language arts and aeveionS^S*!?*" of instruction included 
Phoniei and sigh? readlia^f?^^L'**^^°«'- Systematic and applied 
levels of reading JladlSLs d^fLr""^ "l!^ focusing on various 
Materials includid wrkbloks- S«?^^°'^^2^ comprehension. 
Skill Kits, audirvHSal eSuI^^^ Barnell Loft series? SUA 
sheets. Visual equipment, books, and teacher prepared 



PARTICIPATION IN THE T^r^r.Tl^frr^„ . 



all pI?tl^!as^T^c\:LL^K^d2S?^^^^^^^ 
aSd^\^rr^^=S°? '"lole^Zl ^ "fap%'eaVlo'?^ri^^ 
proportion ol^?l';„drif|-%---^^^^^^^^ 
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NAMES 



PROJECT PROFILE 
^ • : R2R BUDGET? 45/000 



TARGET POPULATION . 

CUMULATIVE ENROLLMENT: 80 PREDOMINANT ETHNIClTYj White 

PREDOMINANT AGE GROUP: Adults ESLi No 



The majority are native-born white adults with severe to 
moderate reading deficiencies (ranging from total non^^eaderf 
to the pre-GED level) . Students are drawn from small towns 
and rural areas and include workers en^loyed in the lumbS 
industry, welfare recipients, housewives, and marginally! 
en5>loyed persons. "*tg*naxiy 

SERVICE DELIVERY SYSTEM 

STRUCTURE: Tu torials INSTRUCTIONAL STAFF: Paid 

SCHOOL CREDIT: Yes LOCATION: Tutees' homes 

with f^S^r^^n^i-S^'^^^®®' covering a large geographic area, 
^ir^v.L^^f^"f for each county. Coordinators are responsible 
for recruitment of both students and tutors, for matching and 
supervision. Each tutor works with several tutees, on a one-to- 

meet one, two, or more times per week, for an average of two 

?S ffrSf r?^^''!?; ^® to accomodlte the ?utee- 

in terms of location, schedule and subject matter— and tutors 
spend considerable time in travel. tutors 

ON-SITE OBSERVATION : 

Five individual tutorial sessions were observed. The form 

^^^'^ session included both teacher directed^ 
activities and independent work bv students. ThrorganizaUonal 
type was characterized as non- structured , and for the roost 
part pre-planning of activities was evident. The conleS? of 

r«fllnf ^""SKP'^^fJ^iy.^^"^^^ language arts and developmental 
m^i^^X TJ^f ."method for developmental reading was primarily 

assisted rG.:icIing, with soir.c syntematic and applied phonics 
Developmental reading focused on decoding and compreSoncfon. 
Materials used included workbooks— Activities for Reading 
toprovement, Steck-Vaughn Literary Series, Mott Basic Language, 

GoAarJnni'^F ^^^^^^ ^^""^^ Programmed testr.^- 

Geography of the U.S{ some hooks and teacher prepared sheets. 
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PARTICIPATIOW IN THE EVALUATION « 



ilJf^.i?'^®*^®® program made testing a tAine-consumlng 

and lengthy process (since each student had to be individually 

r!^f r J^S^f^^®"" ^T^^ • Nonetheless, all InioJSaUon 
required by the evaluation was supplied in toto and on time. 
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TARGET POPULATION 

CUMULATIVE ENROLMENT.. 182 PREDOMINANT ETHNICITV: Black 

PREDOMINANT AGE GROUP: Adults ESLs No 

ruMl*'arer°'5hS =6^*8 income blacks from the surrounding 

SERVICE DELIVERY SYSTEM 

INSTROCTIOHftl STAPP, ypl.tu'tors 

SCHOOL CREDIT: __2o LOCATION: centers and 

Tutor tra4n-r«X trainers, and volunteer tutors. 

iSstrultL^fs avklSle "irorL«J!^"^"^^ °* ^rcup 
orientahion ^ program emphasizes a communltv 

and"ser"le SstS?utfoSs?' '"^ communitr"''^ 

ON-SITE OBSERVATION t 



135 ^O*?- 



page 2 



PARTICIPATION IN THE EVALUATION s 



The structure of the project made the evaluation tasks 
tlwe consuming and difficult. Pre-testing took several months, 
Zw ^*»t® the project was extrenely responsive to 

the study requi^«nents. Many of the students, however, found the 
Real test too difficult to take during the pre-test period. 
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TARGET POPtlLATTOM 

CUHOIATWE ENROLU^T: 115 PREDOMINAIJT ETHNICITY. Black 
PREDOMINAKT AGE GROOPt Adults ESts Mo 

furctlo^af ?!u?e«nrifJiSriM'?."''"^ illiterates and 
SERVICE DELIVERy Sirsmm 

STROCTORE: tutorial IKSTROCTIOMAL STAPP, yoi; 

SCHOOL CREDIT; No_ LOCATION, center and hon... 

the llubaSSIlettof of i„s??;c?lSr 'vl?''^?'" Primarily utilising 
by the paid staff aSl Jhln^tcSSd wi^S'^JSIenS'l^.S'" ''^f'"^ 
convenient manner possible f orblth tutol "'S, 
sessions are usually held at ninh* tutee. Tutoring 

ON-SITE OBSERVATIQW i 

The instruction In all cSSea Sal S«L?!!f^f5' ^"^^ "ours, 
structured in organlzatllnal sfvl^fSI M^Sf "f 'e~»»er directed, 
terms of the seouence of aStLf^i! ''^'''^y structured in 
tlon included lM|Sale arSr de«?f™«^!,''°"'f?' '"^ Instruc- 
8upport,and In 0^0886 Est'jffr^.:2K*"'*^_f®^''^"9' motivational 

thrdev4lopaeSt22%I^!nf LSudlHm^^ SSf a»?f ^ 
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PROJECT PROFILE 
Project X 



R2P BODGETj 5tr/000 
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TARGET POPULATION 

COMUIATIVE ENROLI«ENT: __m_ PKEDOMIKANT ETHMICITV. 
PREDOMINANT AGE GROOPt Adults ESL. No 



minimal coiranand of spoken English as well fn'-SSl^ff^ "^^^ 
sessions are conducted for mentallv r^?«;4^ ?^ f?^*'^*^?' ^"^^^^P 

American alcoholics iLpSrarU^ reL^ ^^^^T« 
Portland. ««iF«J^ai:iAy residing in half-way houses in 

SERVICE DELIVERY SYSTRM 

STROCTORE, ^torlals INSTRUCTIOKAL STAFF: paia 

SCHOOt CREDIT, No LOCATION . K^Jjouse^ 

Kith ISI ^c^r2SS?^^r^^^e'f„^?M^^^^ 

mately 3/4 of the total enroiin;on4.» f program (with approxi- 

exclusively one-to-Sne tutorina s J^fn^""?""* program is 

.nd sessioL are geS^aUrcoSlio?!^^^^'^!^ lo?TS^^?J"?' 

population t^o^»i^^ Vin^I„1«t.^^^^^^^^ 
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QW"SITE OBSERVATIQWi 



Five tutorial sessions were observed. The primary fono of 
instruction was teacher directed, with some independent woS 
by students. The organizational style was characterised as 
structured with a highly structured set of learning activities 
The content of instruction included ESL, language aits?and 
?ne?«2S^^^i "'^t^^^'h f develS^mlntal l^aSing 

fScusfna nH^fL^''°5^°^' ^^l^^ reading.and assisted reading 
in^?nioI ?2 comprehension skills. Materials used 

iSS^ach maKJL^^"'*' ''^^^^^ ^^^'^^ ^^^^ readers, and 



PARTICIPATION IN THE EVALUATION t 



^^i^rsr-I program was highly cooperative with the evaluation 
Di5?na"«J?® problems which the program experienced in coS? 
^^It^^ with evaluation requirements derived from the geooraphic 
niJ?^^*^ S^.r^'JP®®^' persistent rains during the p?|°test 
f^fi^' f"^ ^^f ^i^^ turnover which occurred in toe esslntiallv 
transient populations served by the two half-way housll?^ 
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